Data Sources
Flat files, databases, storage, big data, and notebooks.
Choose a data source
Use this page to orient yourself. Then jump into the specific connector docs:
What “data source” means in PDI
In practice, a data source is either:
A file format you parse (CSV, Excel, JSON, XML).
A service you connect to (a DB, object store, cluster, or API).
Flat files
Use flat files when your data arrives as CSV, TXT, fixed-width, JSON, or XML.
Start here: Flat Files.

Databases
Pentaho connects to databases primarily through JDBC drivers. These drivers are the main interface for database communication.
Start here: Databases.

Storage
Storage sources are cloud or network repositories. Examples include Amazon S3, Azure Blob Storage, and Google Cloud Storage.
In PDI, you typically connect through VFS. You can read and write across hybrid environments.
Start here: Storage.

Big Data
Big data sources require distributed compute. Common examples are Hadoop (HDFS, Hive, HBase), Spark, NoSQL, and Kafka.
PDI provides specialized steps and adapters for these platforms. This lets you transform data where it lives.
Start here: Big Data.

Jupyter Notebook
Jupyter is a web-based notebook for code, visuals, and narrative text. It works well for exploratory analysis and prototyping.
In a PDI workflow, notebooks often handle advanced analysis. PDI handles production orchestration and scheduled pipelines.
Start here: Jupyter Notebook.

Last updated
Was this helpful?
