Member Of Technical Staff (Search Core, Indexing & Data Pipeline Stream)
perplexity
Job Score
100 ptsPerplexity is looking for a highly skilled Expert Systems Engineer to join our Search Core team. For the indexing and data processing stream. This role is critical to building next-generation search products and technologies. You will help drive key decisions around the architecture, design, and implementation of foundational components in our technical stack.
Responsibilities
Design and build core search engine components, especially indexing pipelines, data storage formats that operate at the scale of billions of pages
Develop streaming and batch data processing with YT systems for search index construction in a high-load environment
Push the limits of hardware performance through low-level optimizations and systems-level tuning
Tackle challenges in multithreading, concurrency, and system-level optimization
Design and build core search engine components, including indexing pipelines, retrieval algorithms, and ranking systems that operate at the scale of billions of pages
Develop streaming and batch data processing systems for search index construction in a high-load environment
Push the limits of hardware performance through low-level optimizations and systems-level tuning
Tackle challenges in multithreading, concurrency, and system-level optimization
Qualifications
3+ years of hands-on experience in systems programming (Rust, C++, C, or similar)
Ownership of full project lifecycle — you don't just write a fast inner loop, you care about how the system is built, deployed, operated, and scaled in production
Knowledge of Python or other scripting languages
Knowledge of Data processing systems (YT/Kafka/Hadoop)
Passion for writing clean, efficient, and scalable systems-level code
Strong knowledge of algorithms and data structures, and the ability to apply them effectively
Deep understanding of multithreading, including various approaches, challenges, and trade-offs
Experience building high-load, distributed, and hardware-adjacent services
Solid understanding of Linux internals (syscalls, networking stack, memory model, kernel tuning)
Familiarity with low-level optimization techniques (memory management, cache efficiency, SIMD, profiling)
Preferred Qualifications
Experience developing core components of search engines, databases, or information retrieval systems
Understanding of search fundamentals: indexing, query parsing, ranking, and relevance
Experience with trading systems or other latency-sensitive real-time systems
Familiarity with cloud services, Kubernetes, and AWS infrastructure
About Data
The Data field has undergone a radical transformation with the rise of Generative AI. Data professionals are fundamental for evidence-based decision-making across all industries.
Key specializations include Data Engineering, Data Science, Business Intelligence, Machine Learning Engineering, and Analytics. Tools like SQL, Python, Spark, dbt, and cloud platforms (AWS, GCP, Azure) are essential.
The data market continues with high demand and salaries among the most competitive in the technology sector, with many remote work opportunities.
About Business Intelligence
Business Intelligence (BI) is the area responsible for transforming raw data into strategic information for decision-making. BI professionals build dashboards, reports, and analyses that help companies understand their performance and identify growth opportunities.
Key skills include data modeling (star schema, snowflake), ETL (extraction, transformation, loading), advanced SQL, BI tools (Power BI, Tableau, Looker), data warehousing, KPIs, and business metrics analysis (MRR, churn, cohort). Knowledge of dbt, Airflow, and data pipelines is a differentiator.
BI professionals in technology companies are highly valued, especially those who master data visualization, analytics engineering, and can translate complex data into actionable insights for the business. The field offers opportunities from BI analyst to head of data, with a focus on data-driven decision making.
About Account Manager
The Account Manager is the professional responsible for managing and expanding the relationship with clients after the sale. They act as a strategic partner, ensuring satisfaction, retention, and account growth, connecting client needs with company solutions.
Key skills include relationship management, negotiation, upsell and cross-sell, contract renewal, account planning, business reviews, metrics analysis (NPS, churn, LTV), and CRM knowledge (Salesforce, HubSpot). Communication, empathy, and business vision are fundamental differentiators.
Account Managers in technology and SaaS companies are highly valued, especially those who can increase recurring revenue (MRR/ARR) through account expansion and churn prevention. The field offers opportunities from account executive to director of accounts, with a focus on strategic relationship, revenue growth, and customer success.
Discover Other Areas
Understand the scope of work, key skills, and tools used in different career areas.
About Advertising
The Advertising area is aimed at the planning, creation, and delivery of communication campaigns to promote brands, products, ideas, or services. Professionals in the sector work in advertising agencies or in-house marketing departments in creative fields (art direction, copywriting), strategic planning, account management, and media buying.
About Automation Engineer
The Automation Engineer is the professional responsible for designing, developing, and implementing solutions that automate manual and repetitive processes in IT, infrastructure, testing, and operations. They combine programming knowledge with DevOps and SRE vision to eliminate manual tasks and increase operational efficiency.
Key skills include Infrastructure as Code (Terraform, Ansible, Pulumi), CI/CD (Jenkins, GitHub Actions, GitLab CI), test automation (Selenium, Cypress, Playwright), network automation (Netconf, SDN), RPA (UiPath, Power Automate), and scripting (Python, Bash, PowerShell). Knowledge of Kubernetes, GitOps (ArgoCD, Flux), and automation platforms is a differentiator.
Automation Engineers in technology companies are highly valued, especially those who can create automated deployment pipelines, self-healing infrastructure, and internal developer platforms (IDP). The field offers opportunities from junior automation engineer to automation architect and head of automation.
About Cloud Solutions
The Cloud Solutions area is responsible for designing, implementing, and managing cloud infrastructure and services (AWS, Azure, GCP) for companies. Cloud professionals architect scalable, secure, and cost-optimized solutions, from data center migrations to serverless and multi-cloud architectures.
Key skills include IaC (Terraform, CloudFormation), containers (Docker, Kubernetes), serverless (Lambda, Cloud Functions), managed databases (RDS, DynamoDB, BigQuery), cloud networking (VPC, CDN, load balancer), and security (IAM, WAF, KMS). Knowledge of FinOps, cloud governance, and AWS/Azure/GCP certifications is a differentiator.
Cloud Solutions professionals in technology companies are highly valued, especially those who master multi-cloud architectures, FinOps, and can optimize costs while maintaining performance and security. The field offers opportunities from cloud engineer to cloud solutions architect, head of cloud, and chief cloud architect.
About Systems Analyst
The Systems Analyst is the professional responsible for analyzing, designing, and implementing technology solutions that meet business needs. They act as a bridge between business areas and the development team, ensuring that systems deliver real value to the organization.
Key skills include requirements gathering and analysis, process modeling (BPMN), data modeling, technical and functional documentation, system integration (APIs, microservices), and knowledge of ERPs and CRMs. Tools like Jira, Confluence, Visio, and project management platforms are essential.
Systems Analysts in technology companies are highly valued, especially those who master agile requirements analysis (user stories, backlog), system integration, and solution architecture. The field offers opportunities from junior analyst to solution architect, with a focus on efficiency, quality, and technological innovation.
About Content Writer
The Content Writer is the professional responsible for creating quality written content for websites, blogs, social media, and other digital platforms. They combine writing skills with content strategy and SEO to attract, engage, and convert audiences.
Key skills include blog content creation, landing pages, newsletters, social media content, keyword research, content strategy, editorial calendar, and SEO writing. Knowledge of WordPress, Surfer SEO, Ahrefs, and analytics tools is a differentiator.
Content Writers in technology companies are highly valued, especially those who can create accessible technical content, evergreen content, and content that generates organic traffic. The field offers opportunities from junior content writer to head of content, with a focus on quality, strategy, and content performance.
Comments 0