Warframe Farming Tracker
Tracks which Warframe items you want and tells you how to get them most efficiently
I apparently go on a Warframe binge for a few weeks to months every year.
Warframe has a lot of items to acquire. A lot a lot. That's hard to keep track of for a little kitty brain.
A few years ago, a good friend I play with set up an Appsmith instance and we built a horrendous pile of
JavaScript that used a Google Spreadsheet as a database backend.
Each query took several seconds and it was generally unpleasant to use.
And yet it was so useful we stuck with it for the rest ouf our binge!
Cue a year later, Google has banned our Appsmith instance ("for our protection"). Oops.
Friend wanted to learn making UIs in Godot.
I got roped into a two week hyperfocus and built a data pipeline to parse all available Warframe data.
The end result is a Godot 4/C# application that:
- Parses multiple Warframe item dumps from GitHub
-
Parses the Warframe Wiki database pages
- See Mods/Data, for example
- There's only a handful of data pages, so we don't have to scrape the entire wiki
- Each page is basically just a Lua table full of data
- … so I added a Lua interpreter
- Parses the official Warframe loot tables
- Parses the official Warframe item manifests
- Parses the official Warframe texture manifests
- Parses the official Warframe world state data
- Caches all external requests as long as possible to avoid putting strain on third-party sites
- Combines this mess of around 35 MB of Lua, HTML and JSON into a workable data model
-
Somehow does all this in less than a second
- (cold start from an empty cache takes about 15 seconds, to be fair)
The application isn't publicly available right now.
