Engineering

- No Remote

Apply Now

Who are we:

Join us as we pursue our innovative vision to make machine data accessible, usable, and valuable to everyone. We are a company filled with people who are passionate about our product and seek to deliver the best experience for our customers. At Splunk, we're committed to our work, our customers, having fun, and most meaningfully, to each other's success. Are you passionate about working on critical systems to create tangible customer impact? Would you like the opportunity to work at a growing company that is changing the way that information is used to support business decisions? If this resonates with you, we would love to speak with you.

At Splunk, each and every release of our software is highly scrutinized to meet the demands of our customers. As a Senior Performance Engineer in Test in the Performance, Scalability & Resiliency (PSR) team, you'll have a critical impact on our products' success. Rising to the bespoke challenges of big data security, scalability, performance, and availability will be your passion and ours too!

You will collaborate with peers, field teams, and customers to understand and encapsulate the use-cases into industry-standard benchmarks. You will work with product management and interface directly with our customers to get direct exposure to the usage patterns we strive to satisfy. You will also drive projects to integrate benchmarking into our continuous integration and test automation frameworks. Strong quality ethics, shift left mentality, collaborating closely with software engineers, designers, architects, and product managers to release innovative high-quality products.

What You’ll Do:

This role requires a person familiar with software development and standard methodologies around Performance Certification and Benchmarks. You must have experience developing, configuring, deploying, and debugging in cloud technology-based distribution systems, in addition to on-premises application deployments. You will test a multitude of applications and technologies on our platform.

Familiar with software development and standard methodologies around CICD and Quality Engineering practices. You must have experience developing, configuring, deploying, testing and debugging in cloud technology-based environments such as Kubernetes and distributed systems. You will test on a multitude of technologies.

Day-to-Day Contributions:

Define, design and implement performance / scalability benchmarks on Cisco-Splunk observability portfolio.
Identifies opportunities for engineering productivity improvements or directions, and evangelizes these successfully.
You are expected to understand the system wide functionality and then come up with test plans and automated tests. Collaborate with Developers, PMs and Infra/Operations engineers to deliver a high-quality product.
You must have the ability to find and troubleshoot bugs during testing or automation failures. Aid development with any vital setup and reproduction of scale related issues seen in production to promote collaboration and efficiency.
Helps team estimate software deliverables, often across a multiple sprint timeline.
You are expected to use standard load generation tools like JMeter, Gatling, Locust, Apache's ab etc. There will be a need to develop custom tools and applications to generate large volumes of custom data to test the backend services or agents.
Efficiently working with various profiling tools to identify performance and concurrency bottleneck, propose and implement optimizations to improve the Cisco-Splunk observability portfolio.
Ability to find root cause of performance bottlenecks with profiling tools: flamegraphs, pprof, pstack, qmlprofiler, perf.
You will develop and run Automated Test pipelines needed to certify software that handles large volumes of data.
Be willing to learn, adapt, and adopt modern technologies as needed including software-development and test frameworks.

Who You'll Work With:

You will be part of the Performance, Scale & Resiliency Engineering team. As a part of the team, you will test and certify the entire fleet of microservices and distributed systems using industry standard load generation tools as well as many custom-built tools. If statements like “hundreds of millions calls-per-minute” and “petabytes per minute” don’t scare you, then this will be the team you will want to be a part of! You will collaborate with multiple teams and product managers to ensure that Cisco-Splunk observability products are highly performant.

Who You Are:

This is a technical role that requires a strong background in software development and testing highly scalable, data-intensive, distributed SaaS applications.
You should be able to write high-quality, concurrent and scalable software.
You should have a good working knowledge of cloud based distributed enterprise applications.
The ability to produce and analyse heap dumps, flame graphs, analyse logs etc. to identify hot spots is a must.
You need to have a team-first attitude; this will be critical for success as we test and support hundreds of services.

Required Skills:

Masters or Bachelor’s in Computer Science or an equivalent engineering degree.
8+ years of proven experience · Strong coding skills in Java or Python or Go.
Actively works on building CI/CD for customer facing products.
Hands-on experience and understanding of: TestNG, REST APIs.
Ability to build custom test applications to mimic customer use cases.
Passionate about debugging complex distributed systems.
Good background with Kubernetes, including Helm packaging, and Docker. · Experience with any one of AWS/ Azure / GCP cloud services, Kubernetes and Kafka.

Good to have Skills:

Working knowledge of Git (BitBucket), Artifactory, CI/CD (TeamCity), Bash/Makefile.
Basic knowledge of OpenTelemetry concepts.
Experience working with observability tools such as Splunk, AppDynamics, Grafana.
Knowledge of UI Performance tools like WebPageTest or Playwright etc.

Splunk, a Cisco company, is an Equal Opportunity Employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, national origin, genetic information, age, disability, veteran status, or any other legally protected basis.

Note:

Apply Now

Explore open roles >

Splunk's Hiring Practices

^{Splunk turns machine data into answers. Organizations use market-leading Splunk solutions with machine learning to solve their toughest IT, Internet of Things and security challenges.}

^{We value diversity, equity, and inclusion at Splunk and are committed to equal employment opportunity. Qualified applicants receive consideration for employment without regard to race, religion, color, national origin, ancestry, sex, gender, gender identity, gender expression, sexual orientation, marital status, age, physical or mental disability or medical condition, genetic information, veteran status, or any other consideration made unlawful by federal, state or local laws. We consider qualified applicants with criminal histories, consistent with legal requirements. Click here to review the US Department of Labor’s EEO is The Law notice. Please click here to review Splunk’s Affirmative Action Policy Statement. If you need assistance or an accommodation to apply or during the hiring process, please let us know by completing our Accommodation Request form.}

^{Splunk also has policies in place to protect the personal information candidates disclose to us as part of the application process. Please click here to review Splunk’s Career Site Privacy Policy.

Splunk does not discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. Please click here to review Splunk’s Pay Transparency Nondiscrimination Provision.

Splunk is committed to the health and safety of our employees and customers. Splunk is impacted by the mandates outlined for U.S. Government contractors in President Biden’s Path out of the Pandemic: COVID-19 Action Plan. As a result, Splunk requires U.S. employees, whether assigned to an office or 100% remote, to provide proof of full vaccination, as defined by the CDC. Splunk provides reasonable accommodations for employees who have qualifying medical or religious reasons.

Splunk is also committed to providing access to all individuals who are seeking information from our website. Any individual using assistive technology (such as a screen reader, Braille reader, etc.) who experiences difficulty accessing information on any part of Splunk’s website should send comments to accessiblecareers@splunk.com. Please include the nature of the accessibility problem and your e-mail or contact address. If the accessibility problem involves a particular page, the message should include the URL of that page.

Splunk doesn't accept unsolicited agency resumes and won't pay fees to any third-party agency or firm that doesn't have a signed agreement with Splunk.

To check on your application click here.}