Archives

December 17

Is Your Cache Crispy Fresh?

Our big project these days is a major overhaul of our map tile servers for our Weather Overlays API. We’re moving the entire codebase over to Node.js and using mapnik to generate tile images. Performance and resource usage is a major concern. We need to generate images for more than 20 different weather data sets, some of which update as often as every 2 minutes. To keep our maps snappy and not break the bank, we need to do a really good job caching at every level of resource creation. There are several great caching libraries out there, but we had...

December 10

Kubernetes – Scaling in 2D

We deal with large data at Aeris Weather. Multiple weather metrics, every few square kilometers, updated every few hours covering several weeks, across the whole globe… oh my. And that is just forecast data. A continuous stream of observations, storm cells, fires and other data in addition to forecasts presents our engineering team with a variety of challenging scaling problems. As we take a deep breath to think about how much data that is, that is just the ingestion side. Much like you as you exhale once again, our applications need to output the data back out in meaningful ways to our...

December 2

AerisWeather Winter Newsletter