Sr. Software Engineer - Data Infrastructure Team

#WeAreCrowdStrike and our mission is to stop breaches. As a global leader in cybersecurity, our team changed the game. Since our inception, our market leading cloud-native platform has offered unparalleled protection against the most sophisticated cyberattacks. We’re looking for people with limitless passion, a relentless focus on innovation and a fanatical commitment to the customer to join us in shaping the future of cybersecurity. Consistently recognized as a top workplace, CrowdStrike is committed to cultivating an inclusive, remote-first culture that offers people the autonomy and flexibility to balance the needs of work and life while taking their career to the next level. Interested in working for a company that sets the standard and leads with integrity? Join us on a mission that matters - one team, one fight.

About The Role:

CrowdStrike is looking to hire a Senior Software Engineer to join the Data Infra Engineering team as a Distributed Systems Engineer. In this team, we are on a mission to create a hyper scale data lake, which helps finding bad actors and stopping breaches. The team builds and operates systems to centralize all of the data the falcon platform collects, making it easy for internal and external customers to transform and access the data for analytics, machine learning, and threat hunting.

As a Software Engineer in this team you will be responsible for building our Spark ecosystem in our AWS and DataCenter that includes but not limited to Kubernetes, Flink, Kafka, Spark, MinIO, HDFS, Trino, Hive, Pinot etc. We are looking for candidates that have setup big data scale clusters in the DataCenter or Cloud (PB-scale would be a plus) in the DataCenter/AWS and are passionate about solving problems at high scale. This role involves leading efforts to build State-of-the-art Flink/Spark k8 platform.

What You'll Do:

Design and implement extremely scalable large scale distributed Flink/Spark cluster on Kubernetes platform optimized for Data center environment.

Build micro apps to enable automation of Flink/Spark operations

Perform and oversee a variety of functions to ensure that our Flink/Spark infrastructure on Kubernetes is available, reliable, stable and secure

Applies judgment in analyzing and selecting technologies, installation and maintenance of software and hardware systems that allow multiple Engineering and DataScience teams to interact with this system

Design, write and own APIs, automate and generate reports to visualize cluster health.

Has responsibility for building and maintaining the Flink infrastructure such that software engineers, data analysts and data scientists can run jobs to gather data and insights.

Work on Query systems, like Apache Presto or Trino, Jupyter Notebooks

What You'll Need:

Strong in one or both of field i.e., Flink/ Spark ecosystem with Kubernetes ecosystem background

Strong analytical skills and with deep understanding of Distributed Systems

Strong programming skills in languages as Go, Python or Java

Understanding of Apache Spark ecosystem technologies (Flink operator or Spark Operator, Kafka, FluxCD, ArgoCD, Jenkin Pipelines etc)

Experience with large-scale business critical platforms with Flink/Spark on Kubernetes on data center or cloud.

Experience with continuous deployment on K8 with Helm, fluxCD. ArgoCD etc

Solid understanding of either Flink or Spark(data) and K8 storage systems (Object stores S3/Minio, Spark ephemeral storage, Persistent volumes mapping and claims)

Understanding or Flink streaming/spark memory management and experience with spark internals.

Familiarity with Chef is preferred.

Proven ability to work with both local and remote teams

Strong communication skills both verbal and written

#LI-MB1

#LI-Remote

Benefits of Working at CrowdStrike:

Remote-first culture

Market leader in compensation and equity awards with option to participate in ESPP in eligible countries

Competitive vacation and flexible working arrangements

Physical and mental wellness programs

Paid parental leave, including adoption

A variety of professional development and mentorship opportunities

Access to CrowdStrike University, LinkedIn Learning and Jhanna

Offices with stocked kitchens when you need to fuel innovation and collaboration

Birthday time-off in your local country

Work with people who are passionate in our mission and Great Place to Work certified across the globe

We are committed to fostering a culture of belonging where everyone feels seen, heard, valued for who they are and empowered to succeed. Our approach to cultivating a diverse, equitable, and inclusive culture is rooted in listening, learning and collective action. By embracing the diversity of our people, we achieve our best work and fuel innovation - generating the best possible outcomes for our customers and the communities they serve.

CrowdStrike is committed to maintaining an environment of Equal Opportunity and Affirmative Action. If you need reasonable accommodation to access the information provided on this website, please contact Recruiting@crowdstrike.com, for further assistance.

Tags