Apache Spark

Apache Spark™ is a unified, multi-language engine for large-scale data analytics, supporting batch and streaming data processing, SQL analytics, and machine learning. It enables scalable data science and integrates with popular frameworks, widely adopted by industry leaders.