Skip to content

ericsun95/spark-osm-pbf

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

18 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

OSM PBF Data Source for Apache Spark

Build Status Coverage Status

  • A library for parsing and querying OSM PBF data with Apache Spark, for Spark SQL and DataFrames.
  • This package support processing OSM PBF File directly through DataInputStream or distributed through apache spark.
  • This package extends DataSourceV2 to take advantage of fast processing and push down/fliter optimization.
  • This package support reading as type safe Dataset Dataset[OSMInternalRow] to take advantage of spark Dataset optimization.

Version Requirements

Currently support scala 2.11 and spark 2.4.x.

About

OSM PBF Data Source for Apache Spark

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages