archaeologist
36 expeditions·1,817,193 lines·367 posts·2 papers·Go · JavaScript · Python · Rust · TypeScript
001USEBlog

Grafana/Grafana Labs blog on Grafana Labs

Grafana's official blog on observability, AI, and cost optimization.

#observability#performance#developer-tools#open-source#infra#dx
🤖 AI Assistant Evolution🧠 Agentic AI Observability Performance & Cost Optimization☁️ Cloud & Database Observability🖥️ Developer Tooling & CLI+1
10 posts·6 clusters
002USEBlog● active

Hashicorp/HashiCorp Blog

HashiCorp's blog on infrastructure security, automation, and multi-cloud management.

#security#infra#developer-tools#tutorial#product-engineering#architecture
🔐 Secrets Management & Automation🖥️ Infrastructure Access & SSH🤖 AI & Non-Human Identity☁️ Terraform & Multi-Cloud Infrastructure📜 Policy as Code & Compliance+1
20 posts·6 clusters
003USEBlog● active

Datadoghq/Datadog | The Monitor blog

Datadog's engineering blog: monitoring everything, everywhere, all at once.

#observability#security#infra#deep-dive#developer-tools#performance
🤖 AI & LLM Observability🔒 Security & Compliance🗄️ Database & Query Performance☸️ Infrastructure & Kubernetes🛡️ Code Security & Quality+4
100 posts·9 clusters
004USEBlog● active

Engineering/Engineering at Meta

Meta's engineering blog: scaling infrastructure with AI, security, and performance.

#deep-dive#architecture#performance#security#ml-infra#scaling
🔐 Security & Cryptography🤖 AI Agents & Infrastructure🔍 Search & Retrieval📞 Real-Time Communication🛡️ Configuration Safety & Rollouts+1
9 posts·6 clusters
005USEBlog● active

Dropbox/Dropbox Tech Blog

Dropbox engineering scales storage and AI with pragmatic deep dives.

#deep-dive#architecture#performance#ml-infra#infra#ai
🗄️ Storage & Infrastructure🔍 AI Search & Ranking AI Efficiency & Productivity🧠 Dash Architecture & Context🌱 Intern Program & Culture
10 posts·5 clusters
006USEBlog● active

Eng/Lyft Engineering - Medium

Lyft's engineering blog: scaling marketplace ML and experimentation.

#ml-infra#causal-inference#architecture#product-engineering#deep-dive#dx
🏗️ ML Platform & Infrastructure🔬 Causal Inference & Experimentation📊 Predictive Modeling & Statistics📍 User Experience & Logistics🌐 Localization & AI Scaling+2
10 posts·7 clusters
007USEBlog● active

Engineering/Spotify Engineering

Spotify engineers share practical AI and automation insights.

#ai-agents#api-design#developer-tools#automation#scaling#culture
🤖 AI Agents & Architecture💬 Natural Language Interfaces⚙️ Data Migration Automation📊 Personalization & Storytelling
5 posts·4 clusters
008USEBlog● active

Slack/Engineering at Slack

Slack’s engineering blog: scaling reliability, security, and AI agents.

#security#infra#observability#ai-agents#architecture#scaling
🔒 Security & Infrastructure Modernization🤖 Agentic Systems & Automation📡 Observability & Network Probing🔔 User Experience Redesign Accessibility & Compliance+1
8 posts·6 clusters
009USEBlog● active

Github/The GitHub Blog

GitHub's official engineering blog on tools, community, and developer policy.

#open-source#developer-tools#tutorial#culture#security#dx
🌐 Open Source Community🤖 AI Agent Workflows⚖️ Developer Regulations & Policy📊 Data & Economic Insights💻 GitHub Copilot & CLI+2
10 posts·7 clusters
010USEBlog● active

Discord/Discord Blog

Discord's engineering blog: scaling chat, shipping features, and postmortems.

#infra#reliability#product-engineering#scaling#culture#developer-tools
⚙️ Infrastructure & Reliability📝 Product & Feature Updates🎮 Gaming & Developer Ecosystem🎨 Customization & User Experience🛡️ Safety, Trust & Moderation+4
100 posts·9 clusters
011USEBlog● active

Netflixtechblog/Netflix TechBlog - Medium

Netflix's engineering blog: scaling entertainment with machine learning and media infrastructure.

#deep-dive#architecture#ml-infra#media-processing#scaling#performance
🤖 ML Infrastructure & Lifecycle📡 Live Streaming & Encoding🎥 Media Processing & Workflows🏗️ Architecture Enforcement & Tooling📝 LLM & Recommendation Evaluation+2
10 posts·7 clusters
012USEBlog● recent

Fly/The Fly Blog

Building and running distributed apps on Fly.io's edge cloud.

#deep-dive#architecture#distributed-systems#database#developer-tools#tutorial
🤖 AI Agents & MCP🗄️ SQLite & Litestream GPU & AI Infrastructure🌐 Networking & Infrastructure🔒 Security & Authentication+3
40 posts·8 clusters
013USEBlog● active

Blog/The Cloudflare Blog

Cloudflare's engineering blog on building a secure, agentic internet.

#security#infra#ml-infra#distributed-systems#networking#developer-tools
🛡️ Security & Vulnerability Response🤖 AI Agents & Platform🧠 AI Engineering & Inference🏗️ Infrastructure & Resilience Performance & Optimization+1
20 posts·6 clusters
014USEBlog● active

Tailscale/Blog on Tailscale

Tailscale's engineering blog: practical networking and security for modern infrastructure.

#networking#security#developer-tools#distributed-systems#product-engineering#tutorial
🤖 AI & Access Control📢 Product Updates & Pricing🛠️ Developer Tools & Libraries☸️ Kubernetes & Identity🔒 Security & Networking Deep Dives+3
15 posts·8 clusters
015CONSIDER

nomic-ai/gpt4all

Solid local LLM runner, but the repo is just a marketing page.

#inference-engine#agent-framework
📦 Client Library⚙️ Package Config
4 files·1,171 lines
016USEPython

run-llama/llama_index

The de facto RAG framework, but it's a bloated kitchen sink.

#agent-framework#memory#embeddings#database
📚 Indices & Eval🤖 Agents & LLMs🔔 Callbacks & Schema⚙️ Base & Workflows✂️ Node Parsers+10
480 files·62,547 lines
017CONSIDER

langchain-ai/langchain

Overengineered glue for LLMs that became an industry standard despite itself.

#agent-framework#embeddings#database
⛓️ Chains & Tools🤖 Agents🔬 Smith & Parsers📊 Evaluation & RAG💬 Chat Models+11
500 files·44,636 lines
018USEJavaScript

TabbyML/tabby

Solid self-hosted Copilot alternative for teams that want GPU control.

#agent-framework#model-serving#database
💬 Chat UI🔵 VS Code Agent📡 LSP & Chat📁 File Browser🪝 Hooks & Lib+10
496 files·69,550 lines
019CONSIDER

microsoft/DeepSpeed

Essential for training large models, but overkill for most teams.

#inference-engine#training
❄️ ZeRO Optimizer Inference Engine🔧 Transformer Layers🔬 V2 Kernels🤖 Model Impls+6
489 files·83,477 lines
020CONSIDERPython

BerriAI/litellm

Overengineered LLM gateway that solves problems you probably don't have.

#agent-framework#fine-tuning#web-framework#plugin-system#database
🌐 Proxy Management🔗 HTTP Client🛣️ Router & Proxy🤖 Vertex & Templates📝 OpenAI & Logging+11
500 files·258,467 lines
021USEPython

axolotl-ai-cloud/axolotl

The de facto standard for open-source LLM fine-tuning, but not for beginners.

#agent-framework#training#fine-tuning#compiler#data-pipeline
🔧 Utils & Patching Core Training🔌 Integrations📜 Scripts & Loaders🎯 Training Core+10
428 files·70,744 lines
022USEPython

huggingface/transformers

The de facto standard for transformer models, but bloated and opinionated.

#inference-engine#fine-tuning#llm-library#plugin-system
🤖 Transformers🤖 Transformers🤖 Transformers🤖 Transformers🤖 Transformers+1
500 files·67,213 lines
023USE

ggerganov/llama.cpp

The de facto standard for local LLM inference, but this repo is just its scripts.

#inference-engine#llm-library
🧠 Examples🔌 Examples💻 Examples📦 Model Conversion🧪 Model Conversion+2
21 files·5,036 lines
024CONSIDERTypeScript

lmstudio-ai/lmstudio-js

Overengineered SDK for a niche local LLM tool.

#fine-tuning#plugin-system
💻 Lms Client📦 Lms Shared Types📦 Lms Common🗄 Lms Kv Config🔌 Lms Communication Server+10
256 files·33,854 lines
025SKIPRust

huggingface/text-generation-inference

Maintenance mode project, use vLLM or SGLang instead.

#inference-engine#llm-library#model-serving#compiler
🧠 Text Generation Server🔌 Text Generation Server💻 Text Generation Server📦 Text Generation Server🧪 Text Generation Server+9
147 files·47,608 lines
026USEPython

stanfordnlp/dspy

DSPy: The most important LM framework you're not using yet.

#fine-tuning#llm-library#rag#data-pipeline
🧠 Core & Misc⚙️ Core & Misc💻 Clients🤖 Teleprompt📦 Datasets+5
140 files·21,830 lines
027CONSIDER

unslothai/unsloth

Fastest LLM finetuning library, but only if you use their hardware or specific GPUs.

#inference-engine#agent-framework#training#fine-tuning#compiler
🧠 Models💾 Core & Save🛠 Utilities Triton Kernels🔩 Kernels & CLI+4
88 files·46,412 lines
028CONSIDERGo

mudler/LocalAI

Solid local AI server, but not the innovation it claims.

#inference-engine#agent-framework#fine-tuning#llm-library#security
🧠 Python🔌 Python💻 Python📦 Python🧪 Python+3
90 files·19,644 lines
029USEPython

vllm-project/vllm

The de facto standard for high-throughput LLM serving, but not for beginners.

#inference-engine#agent-framework#llm-library#web-framework#plugin-system
⚙️ Layers & Ops🤖 Models & V1 Worker📋 Config & Loaders🌐 OpenAI Entrypoints🔍 Attention & Quant+10
496 files·295,453 lines
030CONSIDERPython

mistralai/mistral-inference

Official Mistral inference code: minimal, but don't expect a framework.

#inference-engine#fine-tuning#embeddings#multimodal
🧠 Model & Inference💾 KV Cache⚙️ LoRA, RoPE & MoE
13 files·1,557 lines
031SKIPJavaScript

NousResearch/hermes-agent

Over-engineered Swiss Army knife that tries to do everything, masters nothing.

#fine-tuning#plugin-system#database
📦 Core & Misc📦 Core & Misc📦 Core & Misc📦 Core & Misc📦 Core & Misc+118
496 files·301,397 lines
032SKIPTypeScript

openclaw/openclaw

Over-engineered AI gateway that confuses complexity with capability.

#fine-tuning#cli-tool#web-framework#plugin-system#database
🤖 Agents🌐 Gateway🔌 Plugins🛠 Infra📡 Auto Reply+10
500 files·339,788 lines
033CONSIDERPython

huggingface/smolagents

A neat toy for code-gen agents, but not production-ready.

#agent-framework#llm-library#web-framework
🧠 Agent Core🚀 Agent Orchestration🔌 Tool Abstraction📦 File Conversion⚙️ Scoring & Config
75 files·26,435 lines
034USEPython

simonw/llm

Solid Swiss Army knife for LLM CLI work, but not revolutionary.

#agent-framework#fine-tuning#cli-tool#plugin-system#database
🧠 Core Abstractions💻 CLI Orchestration🔍 Model Embeddings📦 Utility Services
47 files·20,374 lines
035USENeurIPS 2017 · 2017

Vaswani et al./Attention Is All You Need

The architecture that rewrote the decade — every major language model traces its lineage here.

#transformers#attention#nlp#deep-learning#architecture#ml
🔀 Self-Attention🎯 Multi-Head Attention📍 Positional Encoding🏗️ Encoder-Decoder Stack Position-wise Feed-Forward+1
15 pages·6 contributions·95,000 cited
036USESOSP 2007 · 2007

DeCandia et al./Dynamo: Amazon's Highly Available Key-Value Store

The paper that gave the industry vocabulary for hard trade-offs — and proved that 'always wrong sometimes' beats 'sometimes unavailable'.

#distributed-systems#key-value#eventual-consistency#availability#storage#databases
🔵 Consistent Hashing🕐 Vector Clocks🔄 Sloppy Quorum & Hinted Handoff🌳 Anti-Entropy via Merkle Trees⚖️ Tunable Consistency (R, W, N)+1
14 pages·6 contributions·8,500 cited