Senior Software Engineer, Agentic Discovery

Role details

About Us At Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world’s largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers to SMBs to Fortune 500 companies. Cloudflare protects and accelerates any Internet application online without adding hardware, installing software, or changing a line of code. Internet properties powered by Cloudflare all have web traffic routed through its intelligent global network, which gets smarter with every request. As a result, they see significant improvement in performance and a decrease in spam and other attacks. Cloudflare was named to Entrepreneur Magazine’s Top Company Cultures list and ranked among the World’s Most Innovative Companies by Fast Company. At Cloudflare, we’re not looking for people who wait for a polished roadmap; we’re looking for the builders who see the cracks in the Internet that everyone else has simply learned to live with. We value candidates who have the instinct to spot a "normalized" problem and the AI-native curiosity to create a solution using the latest tools. Our culture is built on iteration, leveraging AI to ship faster today to make it better tomorrow, while ensuring that every improvement, no matter how small, is shared across the team to lift everyone up. If you’re the type of person who values curiosity over bureaucracy, and that AI is a partner in solving tough problems to keep the Internet moving forward, you’ll fit right in. Available Locations: Lisbon, or London (Hybrid) About the Department Emerging Technologies & Incubation (ETI) is where new and bold products are built and released within Cloudflare. Rather than being constrained by the structures which make Cloudflare a hugely successful business, we are able to leverage them to deliver entirely new tools and products to our customers. Cloudflare’s edge and network make it possible to solve problems at massive scale and efficiency which would be impossible for almost any other organization. About the Team We build the products that enable the next era of the Internet: making domains Readable , Discoverable , and Callable for autonomous AI agents. Here at Cloudflare, agentic discovery is a core part of our vision for the Agentic Internet . As AI agents change how humans and machines find, evaluate, and act on information, businesses need tools to control how they are represented and reached. We build capabilities that enable website owners to prepare their sites for agent interaction, test and observe how agents read their content, establish open interaction standards (like WebMCP and MCP), and create entirely new channels to reach agentic audiences. We are a cross functional group that communicates and collaborates regularly. We celebrate our achievements, support each other when we make mistakes, and hold each other and our work to a high standard. About the Role We are looking for a Senior Software Engineer to serve as a technical anchor and become a subject matter expert on our Agentic Discovery team. In this role, you will define the architecture, core protocols, and multi-team standards powering the next generation of agent-web interactions. As a senior technical leader, you will shape product roadmaps, mentor engineers across Cloudflare, and write technical specifications that drive execution across multiple teams. You will drive engineering excellence across edge infrastructure, data pipelines, protocol layers, and developer tooling, ensuring systems are resilient and complexity is reduced for your peers. What You'll Do Architect and ship high-throughput, resilient production services that make web properties Readable (structured content transformation), Discoverable (indexing and AEO), and Callable (WebMCP, tool-calling APIs, Generative UI) for autonomous agents. Define emerging agent protocols and integrations (MCP, MCP Apps, UCP, MPP, WebMCP). Author architectural specifications and technical designs that guide engineering work both within and outside the ETI team. Partner directly with Product Management, customers and stakeholders to translate customer needs into technical requirements, clarify KPIs, and shape engineering roadmaps. Drive improvements in system health and observability. Lead complex incident responses, conduct post-incident retrospectives, and rearchitect systems to eliminate failure modes and minimize customer-escalation issues. Elevate the engineering process across Cloudflare through code reviews, technical mentorship, architectural governance, and candidate evaluation for engineering hiring. Desirable Skills, Knowledge, and Experience Experience designing scalable system architecture and setting performance metrics in a distributed environment. Experience writing technical specifications and leading cross-functional technical initiatives to completion. Deep understanding of HTTP, APIs, proxies, caching, web security, and performance bottlenecks spanning multi-service architectures. Hands-on experience and deep conceptual understanding of AI agents, tool calling, Model Context Protocol (MCP), or agent harnesses. Ability to partner with product managers and customers to navigate ambiguous problem spaces and iteratively deliver large-scale architecture. Experience mentoring junior and mid-level engineers, contributing to hiring, and driving improvements to engineering processes and incident response workflows. Bonus Points Fluency in async Rust or TypeScript/JavaScript edge runtimes (e.g., Cloudflare Workers) at scale. Active contributions to or leadership in open-source agent frameworks, protocols (e.g., MCP), web standards bodies, browser engines, or network proxies. Track record of resolving complex, multi-team production incidents and driving post-mortem recommendations to completion. Background in search engines, Answer Engine Optimization (AEO), web crawling at scale, or RAG platform engineering. Expertise