Senior Software Engineer, Ai Gateway
kong
Job Score
100 ptsAre you ready to unlock intelligence?
If you don’t think you meet all of the criteria below but are still interested in the job, please apply. Nobody checks every box - we’re looking for candidates that are particularly strong in a few areas, and have some interest and capabilities in others.
The Mission
The AI Gateway team is on a mission to build the central nervous system for the agentic era, enabling developers to securely and reliably connect, observe, and manage their AI and ML services at scale. In this role you will design and build the core of the gateway that handles live AI traffic: the runtime and data plane that route, translate, secure, and observe every request, with the performance and reliability our customers depend on.
What You’ll Do
Own the technical direction for core AI Gateway features, from design to production rollout.
Build and maintain high-performance components for Kong’s AI Gateway in Rust and Lua.
Implement gateway features such as multi-LLM routing and load balancing, caching, guardrails, and observability for AI traffic.
Design integrations with LLM providers and AI platforms, filling the gaps between Kong and third-party deployment platforms and tooling.
Influence the technical roadmap and architecture, and address technical debt before it limits scalability.
Investigate complex production issues and performance bottlenecks, and do low-level optimizations in the hot path.
Work with product management and other engineering teams to turn customer requirements into reliable, documented product features.
Mentor other engineers on the team through code reviews and design discussions.
What You’ll Bring
The Toolkit
5+ years of programming in server-side applications and components, in a language such as Rust or Go.
Experience building and debugging applications that are highly scalable, distributed, reliable and resilient.
Knowledge of networking fundamentals and protocols on both L4 and L7 (TCP/IP, HTTP/2, gRPC).
Solid understanding of API design, and familiarity with API gateways, proxies, or service mesh.
Experience with LLMs and AI infrastructure, such as LLM provider APIs, agent frameworks, model serving, MCP and other agentic AI protocols.
Solid hands-on expertise in Linux systems, including troubleshooting memory issues and profiling processes.
The Kong DNA
Ownership: You take full ownership of your work from concept to production, including the documentation: engineers at Kong write the documentation for their products.
Urgency: You balance quality with the need to deliver value to customers quickly.
Collaboration: You communicate clearly in writing and work effectively with a remotely distributed team.
Leadership: You make and explain technical trade-offs where there is no established playbook.
Bonus Points
Contributions to open-source software projects.
Proficiency with Lua.
Hands-on experience with NGINX and OpenResty.
Experience operating services in cloud-native environments (Kubernetes, Docker, AWS/GCP/Azure).
#LI-EA1
About Kong:
Kong Inc., the AI Connectivity Company, is building the connectivity layer of AI. Trusted by the Fortune 500® and AI-native startups alike, Kong’s unified API and AI platform enables organizations to secure, manage, accelerate, govern, and monetize the flow of intelligence across APIs and AI traffic — on any model, any cloud. For more information, visit www.konghq.com.
About Software Development
Software Development is one of the most dynamic and constantly evolving fields in the job market. Professionals in this area are responsible for creating, maintaining, and optimizing web, mobile, and desktop applications that impact millions of users daily.
Key languages and frameworks include JavaScript (React, Node.js, Vue.js), Python (Django, Flask), Java (Spring), PHP (Laravel), and TypeScript. Demand for full-stack developers continues to grow, especially in tech companies and startups.
Salaries range from entry-level to senior positions, with growing opportunities for remote work and international freelancing.
About Artificial Intelligence
Artificial Intelligence is currently the fastest-growing field in the technology market. The revolution in generative models (GPT, Claude, Gemini) has created massive demand for AI-specialized professionals.
Key areas of practice include Machine Learning Engineering, MLOps, Prompt Engineering, AI Research, and Applied AI. Python, TensorFlow, PyTorch, and LLM knowledge are essential skills.
AI salaries are the highest in the technology sector, with many remote work opportunities at international companies.
Discover Other Areas
Understand the scope of work, key skills, and tools used in different career areas.
About Social Media
The Social Media area is one of the most dynamic and constantly evolving fields in digital marketing. Social media professionals are responsible for creating, managing, and optimizing brand presence on digital platforms, building engagement and community with the target audience.
Key skills include social media management (Instagram, TikTok, LinkedIn, Facebook, YouTube), social media content creation, community management, paid social media (Meta Ads, LinkedIn Ads, TikTok Ads), metrics analysis, and strategic planning. Tools like Hootsuite, Sprout Social, Buffer, Later, and analytics platforms are essential.
Social media professionals in technology companies are highly valued, especially those who master paid social, social media analytics, and content strategies for different platforms. The field offers opportunities from analyst to head of social media, with a focus on growth, engagement, and return on investment.
About Marketing
The Marketing area is strategic for the growth and positioning of any company. It encompasses traditional marketing, brand management, market research, trade marketing, product marketing, and market intelligence. Marketing professionals are responsible for planning and executing strategies that connect brands to their target audience.
Key skills include brand management, market research, competitive analysis, product marketing, trade marketing, pricing, relationship marketing, and channel development. Knowledge of research tools (Nielsen, Kantar, Ipsos), BI, and advanced spreadsheets is a differentiator.
Marketing professionals in technology companies are highly valued, especially those who master product marketing, go-to-market strategy, and data-driven marketing. The field offers opportunities from analyst to CMO, with a focus on growth, brand positioning, and return on investment.
About Content Manager
The Content Manager is the professional responsible for leading the entire content strategy, production, and management of an organization. They define the editorial strategy, coordinate writing teams, and ensure content aligns with business goals and brand identity.
Key skills include content strategy, editorial planning, content audit, buyer persona, customer journey, content ops, content governance, performance metrics (ROI, engagement, organic traffic), and team management. Knowledge of WordPress, Contentful, Notion, and analytics tools is a differentiator.
Content Managers in technology companies are highly valued, especially those who can align content with conversion funnels, lead multidisciplinary teams, and use data to optimize editorial strategy. The field offers opportunities from content manager to head of content, with a focus on strategy, quality, and scale.
About Fullstack
Fullstack developers are versatile professionals capable of working on both frontend and backend of web and mobile applications. They master multiple technologies and can build complete products end-to-end, from the user interface to server infrastructure.
Key skills include proficiency in at least one complete stack (React/Vue/Angular + Node.js/PHP/Python/Java), databases (SQL and NoSQL), REST/GraphQL APIs, Git versioning, CI/CD, and basic infrastructure knowledge (Docker, cloud). Clean architecture, DDD, and testing are important differentiators.
Fullstack developers are highly valued in startups and companies that need versatile and autonomous professionals. The field offers opportunities from junior developer to software architect, with a focus on complete delivery, holistic product vision, and ability to work across multiple application layers.
About Finance
The Finance area in technology companies combines traditional financial knowledge with advanced digital tools. FP&A, controlling, and corporate finance professionals are essential for the organization's financial health.
Key skills include financial modeling, metrics analysis (MRR, ARR, LTV, CAC), ERP (SAP, Oracle), and BI tools. Certifications like CFA and CPA-20 are differentiators.
The financial sector offers stable opportunities with competitive salaries, especially in fintechs and large technology companies.
Comments 0