I had a chance to speak at an online conference last weekend, Hadoop With The Best. I had fun sharing one of my total passions… data pipelines! In particular, some techniques for catching raw user events, acting on those events and understanding user activity from the sessionization of such events.
At svds, we’ll often run spark on yarn in production. Add some artful tuning and this works pretty well. However, developers typically build and test spark application in standalone mode… not on yarn.
Rather than get bitten by the ideosyncracies involved in running spark on yarn -vs- standalone when you go to deploy, here’s a way to set up a development environment for spark that more closely mimics how it’s used in the wild.
Notes from a lunch-and-learn talk. It’s a little weak without the narrative, but I’ll post it here for reference anyway.
- ssh + tmux = <3
- ssh, then tmux
- tmux, then ssh
Continuing the series of regular CharmSchool Hangouts. This week’s video walks through using the new version of the juju local provider. It’s cool!
Continuing the series of regular CharmSchool Hangouts. This week’s video is a little more detail on juju events…
Continuing the series of regular CharmSchool Hangouts. In this week’s charmschool we just sort of sat around and discussed best practices…
I Put together a series of demo videos using juju-0.7 for oscon.
These are really interesting in that they involve migrating environments between providers. This works slightly differently on the newer juju-1.x series, but the idea’s still sound.
There’s no sound on these… they’re raw video backups for demoing juju (in case we lost networking during the demo).
migrate local to hp
Continuing the series of regular CharmSchool Hangouts. In last week’s video we wrote a charm from scratch…
Starting from a simple node.js application, we put together “just enough” charm to get things working. Watch for future episodes where we’ll refactor and refine both the application and the charm.
We’re doing a series of regular CharmSchools on G+ hangouts. Last week we did an intro to juju and charming…
There’re links to the whole series of charmschool hangouts in the juju video archive where we also have videos and screencasts of demos, talks, and any other charm schools we’ve been able to capture on video.
Jorge and I gave a charmschool at the ODS summit. The room was packed with 300+… and they pretty much stayed the whole time… whoohoo!
Watch it here or