DataEngPrep.tech

JavaScript is required to use this application. Please enable JavaScript in your browser settings or disable any extensions that may be blocking scripts.

Loading...

DataEngPrep.tech

Questions Blog Store

Home/Questions/Tag: python

#python

Questions tagged python

All easy (80+)medium (20+)hard (40+)

What is the difference between repartition and coalesce in Apache Spark?

Spark/Big Datamediumpartitionpythonspark1 min read

BCGCitiDunnhumbyFragma Data Systems+3

What is the difference between SparkSession and SparkContext in Spark?

Spark/Big Datahardoptimizationpythonspark0.7 min read

AltimetrikAmerican ExpressCitiHexaware+3

What is the difference between narrow and wide transformations in Apache Spark? Explain with examples.

Spark/Big Datamediumjoinpartitionpython0.9 min read

CoforgeDelivery HeroDunnhumbyFragma Data Systems+1

What are Airflow Operators? Give examples.

Cloud/Toolseasyairflowpythonsql0.5 min read

AltimetrikEYFossil GroupTech Mahindra

Write a Python function to check if a string is a palindrome.

Python/Codingmediumjoinpython0.4 min read

CapcoHashedInLTIMindtree

What is the difference between a list and a tuple in Python?

Python/Codingeasypython0.3 min read

AccentureDelivery HeroFragma Data Systems

Explain the difference between shallow copy and deep copy in Python.

Python/Codingeasypython0.5 min read

Delivery HeroDunnhumbyFragma Data Systems

Write a Python function to find the first non-repeating character in a string.

Python/Codingeasypython0.4 min read

Delivery HeroDunnhumbyFragma Data Systems

What are decorators in Python, and how do they work?

Python/Codingeasypython0.3 min read

Delivery HeroFragma Data SystemsSwiggy

Explain the difference between args and kwargs in Python.

Python/Codingeasypython0.3 min read

Delivery HeroFragma Data SystemsSwiggy

Explain the difference between Azure Data Factory (ADF) and Databricks.

Cloud/Toolseasypythonspark0.6 min read

AccentureEYIncedo

12

When would you architecturally choose Dataset[T] over DataFrame in a Scala Spark pipeline, and what are the scalability and portability trade-offs? Include type-safety benefits vs. operational constraints.

Spark/Big Dataeasy

13

Convert complex SQL (CTEs, window functions, subqueries) to production-grade PySpark. Discuss when to use spark.sql() vs. DataFrame API, and the implications for testability, partitioning, and execution predictability.

Spark/Big Datamedium

14

Explain the benefits of using DataFrames over RDDs.

Spark/Big Datahard

15

How do you optimize Spark jobs for performance?

Spark/Big Datahard

16

What is the difference between Spark RDDs, DataFrames, and Datasets?

Spark/Big Datahard

17

Write a Python function to find the first non-repeating character in a string.

Python/Codingeasy

18

Why is SparkSession used in Spark 2.0 and later versions?

Spark/Big Datahard

19

Write a Python script to find the count of each word in a text file using Spark.

Spark/Big Datamedium

+9 More Questions with Expert Answers

Get the complete 1,800+ question library with detailed, expert-level answers covering SQL, Spark, System Design, Python, Cloud, and Behavioral topics.

Get PDF Bundle - from $21 Try Free Sample

Other Tags

#join #partition #spark #optimization #sql #window #airflow #etl #bigquery #snowflake #lakehouse