Asteris

Mesos Log Format: What Does it All Mean?

// Brian Hicks // Mesos

When you’re using Mesos, sooner or later you’re going to need to look in the logs to figure something out. Inevitably, you’ll be greeted by a line like this:

I0909 22:47:01.240617 21904 master.cpp:3600] Sending 1 offers to framework {id}

Uh… what? How do I read that? What are all those arguments? What even is I0909?

Read More…

When Should I Use Chronos?

// Brian Hicks // Mesos

How can you schedule periodic tasks into your Mesos cluster? For example, if you have a large ETL job that needs to run every night, how do you guarantee consistent runs across the cluster while making sure that the work is scheduled fairly and with a minimum of duplicated effort? This is where Chronos shines.

Read More…

When Should I Use Marathon?

// Brian Hicks // Mesos

When you’re assembling your Mesos cluster, you need to figure out what kind of frameworks are appropriate for the workloads you’re going to run. Marathon comes up a lot in discussions and searches, but is it right for you?

Read More…

What's a "Long-Running" Task?

// Brian Hicks // Mesos

You’re just starting out choosing which components are going to make up your Mesos cluster, and there are a lot of options. Things like Marathon, Chronos, and Aurora, can run long-running or cron-style tasks. But, you say, what does “long-running” actually mean? My Hadoop jobs can take a long time, does that mean they’re long-running? It’s a weird piece of jargon to get your head around the first time, but everyone seems to use it. So, let’s get a definition.

Read More…