get app
    Download Careers360 App
    • Home
    • Udemy
    • Courses
    • Apache Spark with Scala Useful for Databricks Certification

    Apache Spark with Scala useful for Databricks Certification

    BY
    Udemy

    Brochure Enquire
    Lavel

    Beginner

    Mode

    Online

    Fees

    ₹ 449 2299

    Quick Facts

    particular details
    Medium of instructions English
    Mode of learning Self study
    Mode of Delivery Video and Text Based

    Course and certificate fees

    Fees information
    ₹ 449  ₹2,299
    certificate availability

    Yes

    certificate providing authority

    Udemy

    The syllabus

    Introduction

    Download Resources

    Introduction to Spark and Spark Architecture Components

    • Introduction to Spark
    • (Old) Free Account creation in Databricks
    • (New) Free Account creation in Databricks
    • Provisioning a Spark Cluster
    • Basics about Notebooks
    • Why we should learn Apache Spark?
    • Spark Architecture Components
    • Driver
    • Partitions
    • Executors

    Spark Execution

    • Spark Jobs
    • Spark Stages
    • Spark Tasks
    • Practical Demonstration of Jobs, Tasks and Stages

    Spark SQL, Dataframes and Datasets

    • Spark RDD (Create and Display Practical)
    • Spark Dataframe (Create and Display Practical)
    • Anonymus Functions in Scala
    • Extra (Optional on Spark DataFrame)
    • Extra (Optional on Spark DataFrame) in Details
    • Spark Datasets (Create and Display Practical)
    • Caching
    • Notes on reading files with Spark
    • Data Source CSV File
    • Data Source JSON File
    • Data Source LIBSVM File
    • Data Source Image File
    • Data Source Arvo File
    • Data Source Parquet File
    • Untyped Dataset Operations (aka DataFrame Operations)
    • Running SQL Queries Programmatically
    • Global Temporary View
    • Creating Datasets
    • Scalar Functions (Built-in Scalar Functions) Part 1
    • Scalar Functions (Built-in Scalar Functions) Part 2
    • Scalar Functions (Built-in Scalar Functions) Part 3
    • User Defined Scalar Functions

    Spark RDD

    • Operation in Apache Spark
    • Transformations
    • map(function)
    • filter(function)
    • flatMap(function)
    • mapPartitions(func)
    • mapPartitionsWithIndex(func)
    • sample(withReplacement, fraction, seed)
    • union(otherDataset)
    • intersection(otherDataset)
    • distinct([numPartitions]))
    • groupby(func)
    • groupByKey([numPartitions])
    • reduceByKey(func, [numPartitions])
    • aggregateByKey(zeroValue)(seqOp, combOp, [numPartitions])
    • sortByKey([ascending], [numPartitions])
    • join(otherDataset, [numPartitions])
    • cogroup(otherDataset, [numPartitions])
    • cartesian(otherDataset)
    • coalesce(numPartitions)
    • repartition(numPartitions)
    • repartitionAndSortWithinPartitions(partitioner)
    • Wide vs. Narrow Transformations
    • Actions
    • reduce(func)
    • collect()
    • count()
    • first()
    • take(n)
    • takeSample(withReplacement, num, [seed])
    • takeOrdered(n, [ordering])
    • countByKey()
    • foreach(func)
    • Shuffling
    • Persistence (Cache)
    • Unpersist
    • Broadcast Variables
    • Accumulators
    • Important Lecture
    • Bonus

    Similar Courses

    Expertise Spark 2.0 with Scala and Databricks

    Udemy

    Online
    Beginner     ₹ 799

    Courses of your Interest

    Certificate in Database Management using SQL and M...

    Certificate in Database Management using SQL and M...

    Amity Online

    24 Hours Online
    Beginner     ₹27,000 ₹33,000
    Certificate in Dashboarding and Storytelling using...

    Certificate in Dashboarding and Storytelling using...

    Amity Online

    24 Hours Online
    Beginner     ₹27,000 ₹33,000
    Certificate in Spreadsheet Modelling using Excel

    Certificate in Spreadsheet Modelling using Excel

    Amity Online

    24 Hours Online
    Beginner     ₹27,000 ₹33,000
    Certificate in Big Data Analytics

    Certificate in Big Data Analytics

    Amity Online

    40 Hours Online
    Beginner     ₹42,000 ₹52,000
    Certificate in Artificial Intelligence and Deep le...

    Certificate in Artificial Intelligence and Deep le...

    Amity Online

    40 Hours Online
    Beginner     ₹42,000 ₹52,000
    Certificate in Text Mining and NLP

    Certificate in Text Mining and NLP

    Amity Online

    32 Hours Online
    Beginner     ₹32,000 ₹40,000
    Certificate in Descriptive Analytics and Data Pre-...

    Certificate in Descriptive Analytics and Data Pre-...

    Amity Online

    16 Hours Online
    Beginner     ₹17,000 ₹21,000
    Certificate in Applied Data Engineering

    Certificate in Applied Data Engineering

    Amity Online

    60 Hours Online
    Beginner     ₹75,000 ₹100,000
    Certificate in Programming for Data Analytics Usin...

    Certificate in Programming for Data Analytics Usin...

    Amity Online

    24 Hours Online
    Beginner     ₹27,000 ₹33,000
    Certificate in Predictive Analytics Using Python

    Certificate in Predictive Analytics Using Python

    Amity Online

    32 Hours Online
    Beginner     ₹32,000 ₹40,000

    More Courses by Udemy

    Microsoft Excel 2013 Course Beginners Intermediate...

    Udemy

    Online
    Beginner     ₹399 ₹2,699

    Instagram Bot with Python V2 Giveaway Instagram Bo...

    Udemy

    Online
    Beginner     ₹ 799

    Intro To Computer Science With Python and Jupyter ...

    Udemy

    Online
    Beginner     ₹ 799

    Python for Beginners to Advance

    Udemy

    Online
    Beginner     ₹ 2,499

    Learn Python Turtle Using Block Coding

    Udemy

    Online
    Beginner     ₹399 ₹799

    Master Python Basics For Developer

    Udemy

    Online
    Beginner     ₹475 ₹3,499

    Programming in Python for Beginners

    Udemy

    Online
    Beginner     ₹ 799

    Learn Python 3 Programming from Scratch

    Udemy

    Online
    Beginner     ₹475 ₹1,299

    Automate Your Life With Python

    Udemy

    Online
    Beginner     ₹ 2,899

    Learn Python Python for Beginners

    Udemy

    Online
    Beginner     ₹ 1,799

    Trending Courses

    Digital Marketing Courses Fashion Design Courses Data Science Courses Interior Design Courses Graphic Designing Courses Cyber Security Courses Nursing Courses Tally Courses Data Analysis Courses Web Designing Courses Artificial Intelligence Courses Ethical Hacking Courses Free Digital Marketing Courses And certifications Free Artificial Intelligence Courses And Certifications Free Data Analysis Courses And Certifications Free Cyber Security Courses And Certifications Free Data Science Courses And Certifications Free Cloud Computing Courses And Certifications Free Python Courses And Certifications Free Fashion And Textiles Courses And Certifications Free Graphic Designing Courses And Certifications Free Web Designing Courses And Certifications

    Popular Courses

    General Management Courses Public Health Courses Teaching and Education Courses Financial Management Courses Web Development Courses Mathematics Courses Programming Courses Data Science Courses Cyber Security Courses Law Courses Digital Marketing Courses Mechanical Engineering Courses Explore all courses

    Popular Platforms

    upGrad Courses Udemy Courses Edx Courses Swayam Courses Coursera Courses NPTEL Courses Futurelearn Courses Mindmajix Technologies Courses Vskills Courses IIT Kharagpur Courses IIT Kanpur Courses Emeritus Courses Explore all platforms

    Learn more about the Courses

    10 Reasons to Enrol Yourself in a Digital Marketing Course 8 Must-Have Skills for AWS Cloud Architects Planning to Upskill Yourself? Enrol for a Program in Data Science 25+ Tips for Improving Your Graphic Design Skills Top Universities in India Offering Cyber Security Courses 15+ Courses for Learning Data Mining How to Make a Career in the Field of Artificial Intelligence Top 10 Benefits Of Holding A Certification In Business Intelligence Which are the best certification courses for Photography in India A Beginner's Guide to Pursue Python Programming Want to Pursue a Career in Blockchain Technology? Here is all that you need to Know How Entrepreneurs Can Use Machine Learning to Make their Business Successful? The Scope of Artificial Intelligence in India Top 10 Online Courses for Travel Lovers 10 Best Certification Courses After Hospital and Healthcare Management
    Providers
    Close
    Download Careers360 App
    All this at the convenience of your phone

    • Regular Exam Updates

    • Best College Recommendations

    • College & Rank predictors

    • Detailed Books and Sample Papers

    • Question and Answers

    google play
    students
    400M+ Students
    Colleges
    36K+ Colleges
    Exams
    500+ Exams
    eBooks
    3K+ eBooks
    Certification
    16K+ Certifications
    mobile