Senior Member Of Technical Staff, Web Data
cohere
Job Score
100 ptsCohere is a pioneering company based in Toronto that aims to scale intelligence for humanity by training and deploying cutting-edge models for developers and enterprises building AI systems. Our mission is to accelerate the widespread adoption of AI through magical experiences like content generation, semantic search, RAG, and agents.
At Cohere, we take pride in the quality of our work, with each member of our team playing a critical role in enhancing model capabilities and driving customer value. We thrive on pushing boundaries and moving fast to ensure our customers receive the best possible solutions. Our team comprises researchers, engineers, designers, and other experts dedicated to their craft, all working together to build groundbreaking products.
As a Senior Member of Technical Staff specializing in web data for pre-training, you'll have a pivotal role in developing Cohere's large-scale web data pipeline. This involves working with Common Crawl and other vast web corpora, transforming raw, noisy internet data into high-quality training data for pretraining. You will own key components of the data pipeline, including extraction, parsing, deduplication, and filtering.
In addition to these responsibilities, you'll analyze the composition and quality of web data, study its impact on downstream model performance, and collaborate closely with other team members to improve our data processes. This role requires a deep understanding of web data, strong technical skills in data engineering, and an ability to drive innovation and excellence in your work.
If you're passionate about AI, data engineering, and making a meaningful impact, join us on our mission and help shape the future of AI!
Sobre a área de Dados
A área de Dados passou por uma transformação radical com a ascensão da Inteligência Artificial Generativa. Profissionais de dados são fundamentais para tomada de decisão baseada em evidências em todas as indústrias.
As principais especializações incluem Data Engineering, Data Science, Business Intelligence, Machine Learning Engineering e Analytics. Ferramentas como SQL, Python, Spark, dbt e plataformas de cloud (AWS, GCP, Azure) são essenciais.
O mercado de dados continua com alta demanda e salários entre os mais competitivos do setor de tecnologia, com muitas oportunidades para trabalho remoto.