Staff Backend Engineer - Second Horizon | US | Remote

Grafana Labs, the company behind the open observability cloud, is building an AI-native data intelligence system as part of a skunkworks initiative called Second Horizon. The goal is to make Grafana the best place for humans and AI agents to understand and act on real-time enterprise data.

We are looking for a Staff-level Backend Engineer to help build the first production services for this context layer management system. You will design and ship the core backend architecture powering ingestion, context storage, retrieval APIs, and agent-facing integrations.

• Design, implement, test, and operate the first services for context ingestion, indexing, retrieval orchestration, API access, and system administration.
• Build a scalable multi-tenant SaaS foundation including tenant isolation, usage tracking, quotas, audit logs, and background jobs.
• Power agent-facing retrieval workflows with APIs and service interfaces for AI agents, MCP tools, CLIs, and internal applications.
• Work across product and infrastructure, making tradeoffs between fast experimentation and long-term reliability.
• Instrument services with metrics, logs, traces, alerts, and dashboards.
• Contribute to technical direction and engineering practices.

• Strong engineering skills building production-grade, user-facing software systems.
• AI experience with a practical mindset, familiar with AI technologies and frameworks.
• Quick iteration and experimentation, comfortable releasing prototypes.
• Proven initiative and ownership, able to deal with ambiguity.
• Collaborative attitude and effective communication.

• Experience with LLMs, prompt engineering, and building applications powered by GenAI.
• Proven track record of delivering software that made it into production.
• Exposure to working in cloud-native environments (e.g., AWS, GCP, Azure).
• Experience using observability tools to understand and troubleshoot system behavior.

• Experience building or working with agent frameworks or multi-agent workflows.
• Experience as a data analyst or work with data platforms (e.g., Looker, Tableau, PowerBI, Snowflake, DataBricks).
• Experience building tools for data engineering.

Compensation: In the US, the base compensation range is $174,986 - $209,983. Actual compensation may vary based on level, experience, and skillset.

Benefits: Equity, bonus (if applicable), and other benefits. Global annual leave policy of 30 days per annum.

Location: Remote in the US or Canada. Residents of Quebec are not eligible.

Application: Apply via the provided link.