Spark [Executor & Driver] Memory Calculation

Course Lessons

1. 1- All about [What is Big Data] ?
2. 2- Big Data Engineering Road Map
3. 3- List of Big Data Service Providers
4. 4- BigData System Configuration
5. 5- Unboxing [Hadoop Framework]
6. 6- Hadoop Distributed File System (HDFS)
7. 7- HDFS Quotas , Use Cases
8. 8- Hadoop Single Node Setup
9. 9- MapReduce Complete Video
10. 10- Apache Hive Introduction & Architecture
11. 11- Installation [ Apache Hive 2 with MySQL ]
12. 12- Hive SQL [Create Load Insert Show]
13. 13- Hive Internal Vs External Table
14. 14- Hive Partition [ Static Vs Dynamic]
15. 15- Hive Bucket End to End Explained
16. 16- How to Decide [Bucket Count] in Hive #hive #apachehive
17. 17- Hive Partition with Bucket Explained
18. 18- Hive ORC File Format with Demo
19. 19- Hive ACID Table
20. 20- Hive UDF
21. 21- Apache Spark Introduction
22. 22- Apache Spark Installation
23. 23- Apache Spark Scala Wordcount Program (REPL)
24. 24- Spark Standalone Architecture
25. 25- Unboxing Spark RDD
26. 26- Different Ways to Create [Spark RDD]
27. 27- Spark Transformation Types and Actions
28. 28- Spark Executor Core & Memory Explained
29. 29- Spark [Executor & Driver] Memory Calculation
30. 30- Spark Submit Cluster [YARN] Mode
31. 31- Spark Lens Integration [Spark Application]
32. 32- Spark [Hash Partition] Explained
33. 33- Spark [Custom Partition] Implementation
34. 34- Spark With JDBC (MYSQL/ORACLE)
35. 35- Apache Spark UDF
36. 36- Spark - Repartition Or Coalesce
37. 37- Apache Spark SQL With Apache Hive
38. 38- Spark reduceByKey Or groupByKey
39. 39- Spark Dedup With Use Cases
40. 40- Is PySpark UDF is Slow? Why ?
41. 41- Spark - Calculate Moving Average
42. 42- Spark Market Basket Algorithm Part - 1
43. 43- PySpark Calculate Frequency Table
44. 44- PySpark Types of Drop Null Records
45. 45- Print Spark Data Lineage
46. 46- Spark Logical & Physical Plan
47. 47- Hadoop Multi Node Cluster Setup
48. 48- Apache Kafka Installation and Use Case
49. 49- Spark Kafka Cassandra End to End Streaming Project
50. 50- Do Data Engineers Need Cloud Computing ?
51. 51- Big Data - On Premise Or Cloud ?
52. 52- Big Data On Cloud AWS EMR
53. 53- Google Dataproc BigData Managed Service
54. 54- Google Dataproc and BigQuey Project
55. 55- NoSql: CAP Theorem- Part 1
56. 56- NoSql Support all CAP Rules Part-2
57. 57- Types of NOSQL Data Store
58. 58- HBase Installation
59. 59- Why I Use [HBase NQSQL] #hbase #nosql #bigdata
60. 60- Apache SQOOP Data Migration POC
61. 61- 10 Big Data Interview Question That I Ask - Part 1
62. 62- Top 10 Points to Explain Big Data Project In Interview
63. 63- Top 10 Interview Answers Explained - Part 2
64. 64- Big Data Engineering Resume Preparation
65. 65- Big Data Project Explained -1
66. 66- Big Data Project Deployment Explained
67. 67- Write Your 1st BigData Blog
68. 68- Data Engineering Job opening #visa
69. 69- Data Engineering Job Description Reviews
70. 70- Data Engineer Salary 2021
71. 71- 4 Ways For Data Engineers To Make Extra Income
72. 72- How to get Latest Data Engineering News
73. 73- Canva Data Platform Architecture
74. 74- Netflix Data Engineering Tools #shorts
75. 75- Data Scientist Salary 2023