Fast Data Processing with Spark 2 - Third Edition

Krishna Sankar

ISBN 10: 1785889273 / ISBN 13: 9781785889271

Editore: Packt Publishing Limited, GB, 2023

Learn how to use Spark to process big data at speed and scale for sharper analytics. Put the principles into practice for faster, slicker big data projects.About This Book. A quick way to get started with Spark - and reap the rewards. From analytics to engineering your big data architecture, we've got it covered. Bring your Scala and Java knowledge - and put it to work on new and exciting problemsWho This Book Is ForThis book is for developers with little to no knowledge of Spark, but with a background in Scala/Java programming. It's recommended that you have experience in dealing and working with big data and a strong interest in data science.What You Will Learn. Install and set up Spark in your cluster. Prototype distributed applications with Spark's interactive shell. Perform data wrangling using the new DataFrame APIs. Get to know the different ways to interact with Spark's distributed representation of data (RDDs). Query Spark with a SQL-like query syntax. See how Spark works with big data. Implement machine learning systems with highly scalable algorithms. Use R, the popular statistical language, to work with Spark. Apply interesting graph algorithms and graph processing with GraphXIn DetailWhen people want a way to process big data at speed, Spark is invariably the solution. With its ease of development (in comparison to the relative complexity of Hadoop), it's unsurprising that it's becoming popular with data analysts and engineers everywhere. Beginning with the fundamentals, we'll show you how to get set up with Spark with minimum fuss. You'll then get to grips with some simple APIs before investigating machine learning and graph processing - throughout we'll make sure you know exactly how to apply your knowledge. You will also learn how to use the Spark shell, how to load data before finding out how to build and run your own Spark applications. Discover how to manipulate your RDD and get stuck into a range of DataFrame APIs. As if that's not enough, you'll also learn some useful Machine Learning algorithms with the help of Spark MLlib and integrating Spark with R. We'll also make sure you're confident and prepared for graph processing, as you learn more about the GraphX API.Style and approachThis book is a basic, step-by-step tutorial that will help you take advantage of all that Spark has to offer. Codice articolo LU-9781785889271

Riassunto:

Key Features A quick way to get started with Spark - and reap the rewards From analytics to engineering your big data architecture, we’ve got it covered Bring your Scala and Java knowledge - and put it to work on new and exciting problems Book Description When people want a way to process big data at speed, Spark is invariably the solution. With its ease of development (in comparison to the relative complexity of Hadoop), it’s unsurprising that it’s becoming popular with data analysts and engineers everywhere. Beginning with the fundamentals, we’ll show you how to get set up with Spark with minimum fuss. You’ll then get to grips with some simple APIs before investigating machine learning and graph processing - throughout we’ll make sure you know exactly how to apply your knowledge. You will also learn how to use the Spark shell, how to load data before finding out how to build and run your own Spark applications. Discover how to manipulate your RDD and get stuck into a range of DataFrame APIs. As if that’s not enough, you’ll also learn some useful Machine Learning algorithms with the help of Spark MLlib and integrating Spark with R. We’ll also make sure you're confident and prepared for graph processing, as you learn more about the GraphX API. What you will learn Install and set up Spark in your cluster Prototype distributed applications with Spark's interactive shell Perform data wrangling using the new DataFrame APIs Get to know the different ways to interact with Spark's distributed representation of data (RDDs) Query Spark with a SQL-like query syntax See how Spark works with big data Implement machine learning systems with highly scalable algorithms Use R, the popular statistical language, to work with Spark Apply interesting graph algorithms and graph processing with GraphX About the Author Krishna Sankar is a Senior Specialist - AI Data Scientist with Volvo Cars focusing on Autonomous Vehicles. His

L'autore:

Krishna Sankar is a chief data scientist at http://www.blackarrow.tv/, where he focuses on optimizing user experiences via inference, intelligence, and interfaces. His earlier roles include principal architect, data scientist at Tata America Intl, director of a data science and bioinformatics start-up, and a distinguished engineer at Cisco. He has spoken at various conferences, such as Strata-Sparkcamp, OSCON, Pycon, and Pydata about predicting NFL ( http://goo.gl/movfds), Spark ( http://goo.gl/E4kqMD), data science ( http://goo.gl/9pyJMH), machine learning ( http://goo.gl/SXF53n), and social media analysis ( http://goo.gl/D9YpVQ). He was a guest lecturer at Naval Postgraduate School, Monterey. His blogs can be found at https://doubleclix.wordpress.com/. His other passion is Lego Robotics. You can find him at the St. Louis FLL World Competition as the robots design judge.

Holden Karau is a software development engineer and is active in the open source. She has worked on a variety of search, classification, and distributed systems problems at IBM, Alpine, Databricks, Google, Foursquare, and Amazon. She graduated from the University of Waterloo with a bachelor's of mathematics degree in computer science. Other than software, she enjoys playing with fire and hula hoops, and welding.

Dati bibliografici

Titolo: Fast Data Processing with Spark 2 - Third ...
Casa editrice: Packt Publishing Limited, GB
Data di pubblicazione: 2023
Legatura: Digital
Condizione: New
Edizione: terza edizione