Options for Feast production datasources?

379 views Asked by At

I'm looking into the FEAST feature store. I realize for production, datasources had to be either AWS redshift or Google Bigquery. (isn't this contradicts to the ideas of open source?) But I had my own small server (actually some AWS spot instance) I wanted to utilize. Is there a way to use Feast in production without actually using paying use AWS redshift or Google Bigquery?

1

There are 1 answers

0
Anton On

Here is the list of currently supported integrations. Red Shift and Big Query are just defaults if you use AWS/GCP provider. These defaults can be overwritten by simply modifying feature_store.yaml.

For instance:

registry: gs://anton-feast-tutorial/registry.db
project: fraud_tutorial
provider: gcp
online_store:
  type: redis
  connection_string: localhost:6379

The last there lines here would change the default GCP DataStore to your local Redis instance as an Online datastore.

Same approach works for data sources and offline store. This would add Postgres as your offline store:

...
offline_store:
    type: feast_postgres.PostgreSQLOfflineStore # MUST be this value
    host: localhost
    port: 5432              # Optional, default it 5432
    database: postgres
    db_schema: my_schema
    user: username
    password: password