Arc Notes Weekly #71: Codex
This week, We'll chronicle the crumbling corporate romance with open source, gawk at the dizzying heights of billion-scale benchmarks, and pour one out for the passkeys that promised to liberate us from password purgatory.
This week, We'll chronicle the crumbling corporate romance with open source, gawk at the dizzying heights of billion-scale benchmarks, and pour one out for the passkeys that promised to liberate us from password purgatory.
Enjoy this week's round-up!
— Mahdi Yusuf (@myusuf3)
👋🏾 You are reading Architecture Notes - Your Sunday newsletter, which curates best system design and architecture news from around the web. We would appreciate you sharing it with like-minded people or a kind word on Twitter.
Articles
Scaling to Count Billions - Canva Engineering Blog
They started tracking creator content usage in MySQL, but as data exploded, processing that took O(how many days do you have?) database round trips. After dabbling with DynamoDB, they finally saw the light and moved to an OLAP database. Billions of events now aggregate in minutes instead of "please don't break, please don't break".
The only two log levels you need are INFO and ERROR | nicole@web
Apparently we've been doing logging all wrong, folks. This post argues that the only log levels you need are INFO ("don't wake me") and ERROR ("WAKE UP NOW"). Those other ones like WARN and DEBUG? Useless cruft. Just make everything INFO, and if it's actually important, make it an ERROR. Oh and while you're at it, stop adding temporary debug logs. If you need 'em once, you'll need 'em again. You're welcome.
Helping You Flex Your Product Muscles.
Don’t Be Left Out of the Engineering Revolution! Discover what top engineers are learning from PostHog’s Product for Engineers newsletter. Whether it’s curated advice or the very lessons that shaped PostHog, this is the go-to source for anyone looking to make an impact. Subscribe for free and be part of the future, today!
Product for Engineers | Andy Vandervell | Substack
Building DoorDash’s Product Knowledge Graph with Large Language Models - DoorDash Engineering Blog
DoorDash is harnessing LLMs to automate product attribute extraction, making their knowledge graph smarter and more scalable. From identifying new brands to labeling organics to generalized extraction, LLMs are doing the heavy lifting. Next up: multimodal LLMs digesting product images and democratizing LLM power to the people. All hail our new knowledge overlords!
Firstyear’s blog-a-log
Passkeys, the would-be password killer, are circling the drain due to corporate shenanigans and crap user experiences that make entering your login deets look downright delightful by comparison. Stick with a password manager for now - at least it won't nuke your credentials because it felt like it.
Projects
hacker labs · pico.sh
Pico.sh is here to scratch that developer itch for publishing things with as little fuss as possible. Their secret sauce? Letting you deploy sites, share code, and more all through the SSH tools already in your CLI toolbelt.
FireCrawl
FireCrawl is here to make your LLM dreams come true, one markdown file at a time. This nifty tool crawls websites and magically transforms them into squeaky clean, LLM-optimized data. Dynamic content? No sitemap? No problem! FireCrawl fearlessly ventures into the depths of the web, wielding proxies and caches to bring back the goods at lightning speed.
❤️ The Favourites - this section won't make an appearance every week, will usually be something that was a particularly high point in tech that impacts us all. If you see something worthy of the favourite, tweet at @arcnotes
IBM to Acquire HashiCorp, Inc. Creating a Comprehensive End-to-End Hybrid Cloud Platform
Big Blue breaks out the checkbook again, dropping a cool $6.4B on HashiCorp to beef up its hybrid cloud and AI street cred. HashiCorp's bag of tricks helps tame the wild and wooly world of multi-cloud infrastructure - something enterprises are wrestling with more than ever thanks to the generative AI hype tornado. Over 4,400 customers are already on the HashiCorp bandwagon, so IBM's betting big it can ride that sucker to accelerated growth in the Kubernetes fuelled cloud wars.