Pandas API on Spark#
This page gives an overview of all public pandas API on Spark.
Note
pandas API on Spark follows the API specifications oflatest pandas release.
- Input/Output
- General functions
- Series
- Constructor
- Attributes
- Conversion
- Indexing, iteration
- Binary operator functions
- Function application, GroupBy & Window
- Computations / Descriptive Stats
- Reindexing / Selection / Label manipulation
- Missing data handling
- Reshaping, sorting, transposing
- Combining / joining / merging
- Time series-related
- Spark-related
- Accessors
- Date Time Handling
- String Handling
- Categorical accessor
- Plotting
- Serialization / IO / Conversion
- Pandas-on-Spark specific
- DataFrame
- Constructor
- Attributes and underlying data
- Conversion
- Indexing, iteration
- Binary operator functions
- Function application, GroupBy & Window
- Computations / Descriptive Stats
- Reindexing / Selection / Label manipulation
- Missing data handling
- Reshaping, sorting, transposing
- Combining / joining / merging
- Time series-related
- Serialization / IO / Conversion
- Spark-related
- Plotting
- Pandas-on-Spark specific
- Index objects
- Window
- GroupBy
- Resampling
- Options and settings
- Machine Learning utilities
- Extensions
- Testing