Job Information
LinkedIn Staff Software Engineer, Systems Infrastructure (Retrieval Engine) in Bengaluru, India
LinkedIn is the world’s largest professional network, built to create economic opportunity for every member of the global workforce. Our products help people make powerful connections, discover exciting opportunities, build necessary skills, and gain valuable insights every day. We’re also committed to providing transformational opportunities for our own employees by investing in their growth. We aspire to create a culture that’s built on trust, care, inclusion, and fun, where everyone can succeed.
Join us to transform the way the world works.
This role will be based in Bangalore, India.
At LinkedIn, we trust each other to do our best work where it works best for us and our teams. This role offers a hybrid work option, meaning you can both work from home and commute to a LinkedIn office, depending on what’s best for you and when it is important for your team to be together.
As part of our world-class software engineering team, you will be charged with building the next-generation infrastructure platforms for LinkedIn with focus on information retrieval(IR). IR domain is an ever evolving space with latest state of the art technologies around Embedding Based Retrieval(EBR) , Retrieval Augmented Generation(RAG) and Semantic search to name a few. You will be part of the IR engines team that is responsible for developing a high performance distributed database built using Rust to support multiple retrieval use cases with dense and sparse vectors. You will be working on designing and building various components for the retrieval engine to allow for sub second retrieval with advanced matching capabilities, scaling storage and indexing for billions of documents. You will work and learn among the best, putting to use your passion for distributed technologies and algorithms, API design and systems-design, and your passion for writing code that performs at an extreme scale.
LinkedIn has already pioneered well-known open-source infrastructure projects like Apache Kafka, Pinot, Azkaban, Samza, Venice, Datahub, Feather, etc. We also work with industry standard open source infrastructure products like Kubernetes, GRPC and GraphQL - come join our infrastructure teams and share the knowledge with a broader community while making a real impact within our company.
Responsibilities:
You will own the technical strategy for broad or complex requirements with insightful and forward-looking approaches to handle retrieval for large datasets with multiple query patterns
You will design, implement, and optimize the performance of the underlying querying, storage and indexing systems
You will Improve the observability and understandability of retrieval systems with a focus on improving developer productivity and system sustenance
You will effectively communicate with the team, partners and stakeholders.
You will mentor other engineers, define our challenging technical culture, and help to build a fast-growing team
You will work closely with the open-source community to participate and influence cutting edge open-source projects
You will deliver incremental impact by driving innovation while iteratively building and shipping software at scale
You will diagnose technical problems, debug in production environments, and automate routine tasks
Basic Qualifications:
BA/BS Degree in Computer Science or related technical discipline, or related practical experience.
8+ years of industry experience in software design, development, and algorithm related solutions.
8+ years experience programming in languages such as Rust (preferred), C/C++
Hands on experience developing distributed systems, large-scale systems, databases and/or Backend APIs
Preferred Qualifications:
Experience of designing and working with the architecture of search engines and database systems, with focus on performance and scalability.
Experience with open source projects like Apache Lucene, RocksDB and vectors DBs like Qdrant/Milvus.
Experience in architecting, building, and running large-scale low latency distributed systems
Suggested Skills:
Distributed systems
Backend Systems Infrastructure
Rust, C/C++
India Disability Policy
LinkedIn is an equal employment opportunity employer offering opportunities to all job seekers, including individuals with disabilities. For more information on our equal opportunity policy, please visit https://legal.linkedin.com/content/dam/legal/Policy_India_EqualOppPWD_9-12-2023.pdf
Global Data Privacy Notice for Job Candidates
This document provides transparency around the way in which LinkedIn handles personal data of employees and job applicants: https://legal.linkedin.com/candidate-portal