Narrow and Wide Transformations
- Narrow transformation:A single output partition can be computed from a single input partition 不需要考虑数据分区 eg.
filter(), contains()
- Wide transformation 要考虑数据处于不同的 partition,eg.
groupBy(), orderBy()
filter(), contains()
groupBy(), orderBy()