SAN FRANCISCO – OverOps, the leading solution for root cause analysis at runtime, today debuted its support for Apache Spark, the popular open-source analytics engine for large-scale data processing. This support allows developers to identify and resolve critical exceptions on Spark jobs in minutes, eliminating the need for laborious and time-consuming detective work in searching logs to figure out why their Apache Spark job broke. With no code changes required, OverOps captures a full stack trace of when, where, and why exceptions occurred along with the associated variable state.
Hundreds of thousands of developers at companies like Amazon, Autodesk, Databricks, eBay, Microsoft, Shopify, Samsung, and TripAdvisor rely on Apache Spark for big data analytics. The reality is that issues with configuration, formatting, data and outdated code can all cause a Spark job to fail. In addition, operational challenges due to the distributed nature of Spark make it hard to debug production issues.
Learn more in the OverOps blog by staff engineer Chris Caspanello, who demonstrates in a video how Spark developers can use OverOps to instantly find why Spark jobs fail.
As part of the announcement, OverOps is offering a free 14-day trial subscription.
OverOps root cause analysis at runtime instantly pinpoints why critical issues break backend Java and .NET applications. No detective work, such as searching logs, is required to reproduce critical exceptions. OverOps provides the precise line of code and associated variables at the moment the exception occurred. For pre-prod, critical issues are identified and resolved before being promoted to production, and before impacting the customer. There is no guesswork such as in test planning. OverOps is easy to use, requires no code changes, plugs into your CI/CD, and integrates with other observability tools. All this empowers engineering teams to develop fast without sacrificing quality. The company is backed by Lightspeed Venture Partners and Menlo Ventures and has offices in San Francisco, Orlando, and Tel Aviv.