Reference

Reference material for working with the Spark codebase. Pages here are flat lookup tables rather than narrative documentation.

• configuration.md - where Spark configs are declared and the major config families.
• dependencies.md - third-party dependencies that show up across the build.

External references:

• User-facing configuration guide.
• SQL configuration reference.
• Built-in SQL function reference.
• Migration guides (Core, SQL, MLlib, Streaming, Structured Streaming) - the in-tree sources are docs/*-migration-guide.md.