Elasticsearch - Senior Performance Engineer - Benchmarking

Apply     

Elastic is a search company that powers enterprise search, observability, and security solutions built on one technology stack that can be deployed anywhere. From finding documents to monitoring infrastructure to hunting for threats, Elastic makes data usable in real time and at scale. Thousands of organizations worldwide, including Barclays, Cisco, eBay, Fairfax, ING, Goldman Sachs, Microsoft, The Mayo Clinic, NASA, The New York Times, Wikipedia, and Verizon, use Elastic to power mission-critical systems. Founded in 2012, Elastic is a distributed company with Elasticians around the globe. Learn more at elastic.co

Engineering a distributed system that is easy to operate via elegantly designed APIs is a challenge. It requires software development skills and the ability to think like a user. We care deeply about giving you ownership of what you’re working on. Our company believes we achieve greatness when they are set free and are surrounded and challenged by their peers. At Elastic, we feel that you should be empowered to comment on anything, regardless of your role within the company. Our team builds Elasticsearch, the heart of the Elastic Stack.

We are looking for an engineer to join the Elasticsearch Engineering Performance team to focus on helping us understand how Elasticsearch performs and scales under workloads representative of our three main solutions: search, observe, protect. This person will provide clarification around sizing and performance guidance that our field organization and our users will leverage to design deployments across a variety of use cases. Our users range from small startups who want to add a search bar to their website to large corporations deploying our full suite of observability products across their entire infrastructure. Our mission is to enable each of them to deploy our software in a way that will set them up for success and grow with them.

Here are the kinds of questions this person will create guidance for:

  • If a user needs to index 200 gigabytes of Apache logs per day and has a 10-day retention policy, what should that Elasticsearch cluster look like? What if retention is two years?
  • For a user of Elastic's Security solution with 10,000 endpoints deployed, how large will their cluster need to be in order to perform an investigation spanning the previous five years of activity in their organization?
  • How does query performance change as data ages from a hot tier with fast SSDs to a cold tier with slow spinning disks?

Answering these questions would need you to craft, execute, and interpret realistic benchmarks based on actual usage of our products. To get there, you will partner with other engineering teams to understand how our various products and solutions exercise Elasticsearch, as well as with our field organization and product management teams to turn benchmark results into meaningful and actionable guidance.

What you bring along:

  • An understanding of benchmarking methodology. Can you explain what makes a benchmark useful? Can you describe some common pitfalls that people encounter when they try to benchmark a system?
  • A background in a technical customer-facing role. Maybe you've been a sales engineer, or a consultant, or a support engineer.
  • Python experience. You will be contributing to our benchmarking infrastructure and tooling (such as Rally) which is written in Python.
  • Strong Linux skills. You should be comfortable on the command line, have experience with observability tools such as iostat, nstat, vmstat, and know your way around procfs, etc.
  • Knowledge of Java and the JVM, or a strong desire to learn. While you will not be writing Java day-to-day, Elasticsearch is a Java application.

#Additional Information - We Take Care of Our People

As a distributed company, diversity drives our identity. Whether you’re looking to launch a new career or grow an existing one, Elastic is the type of company where you can balance great work with great life. Your age is only a number. It doesn’t matter if you’re just out of college or your children are; we need you for what you can do.

We strive to have parity of benefits across regions and while regulations differ from place to place, we believe taking care of our people is the right thing to do.

  • Competitive pay based on the work you do here and not your previous salary
  • Health coverage for you and your family in many locations
  • Ability to craft your calendar with flexible locations and schedules for many roles
  • Generous number of vacation days each year
  • Double your charitable giving — we match up to 1% of your salary
  • Up to 40 hours each year to use toward volunteer projects you love
  • Embracing parenthood with minimum of 16 weeks of parental leave

Elastic is an Equal Employment employer committed to the principles of equal employment opportunity and affirmative action for all applicants and employees. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status or any other basis protected by federal, state or local law, ordinance or regulation. Elastic also makes reasonable accommodations for disabled employees consistent with applicable law.

#LI-CD2

When you apply to a job on this site, the personal data contained in your application will be collected by Elasticsearch, Inc. (“Elastic”) which is located at 800 W. El Camino Real, Suite 350 Mountain View, CA 94040 USA, and can be contacted by emailing jobs@elastic.co. Your personal data will be processed for the purposes of managing Elastic’s recruitment related activities, which include setting up and conducting interviews and tests for applicants, evaluating and assessing the results thereto, and as is otherwise needed in the recruitment and hiring processes. Such processing is legally permissible under Art. 6(1)(f) of Regulation (EU) 2016/679 (General Data Protection Regulation) as necessary for the purposes of the legitimate interests pursued by Elastic, which are the solicitation, evaluation, and selection of applicants for employment. Your personal data will be shared with Greenhouse Software, Inc., a cloud services provider located in the United States of America and engaged by Elastic to help manage its recruitment and hiring process on Elastic’s behalf. Accordingly, if you are located outside of the United States, your personal data will be transferred to the United States once you submit it through this site. Because the European Union Commission has determined that United States data privacy laws do not ensure an adequate level of protection for personal data collected from EU data subjects, the transfer will be subject to appropriate additional safeguards under the standard contractual clauses. You can obtain a copy of the standard contractual clauses by contacting us at privacy@elastic.co. Elastic’s data protection officer is Daniela Duda, who can be contacted at daniela.duda@elastic.co. We plan to keep your data until our open role is filled. We cannot estimate the exact time period, but we will consider this period ended when a candidate accepts our job offer for the position for which we are considering you. When that period is over, we may keep your data for an additional period no longer than 3 years in case additional opportunities present themselves in which yours skills might be better suited. For additional details, please see our Elastic Privacy Statement https://www.elastic.co/legal/privacy-statement.

Apply     
Learn about Elastic's Culture

Notify Me of Open Positions

Sign in with your social account to receive emails when Elastic posts open positions you might be interested in:

{{alert.msg}}