Claires suggestions

[clrcrl]

Did these in separate commits so you can take or leave what you'd like!

1. Add a gitignore

   • As soon as I tried to run dbt, I had a ton of files I didn't want to commit, so I added a .gitignore

2. Specify a project (database) for sources

   • Adding the database: parameter (== project on BQ) means that I can query things in your project! However, it breaks dbt docs generate since I don't have permission to read your information schema:

$ dbt docs generate
Running with dbt=0.15.2
Found 6 models, 0 tests, 0 snapshots, 0 analyses, 138 macros, 0 operations, 0 seed files, 2 sources

14:48:19 | Concurrency: 8 threads (target='dev_bigquery')
14:48:19 |
14:48:20 | Done.
14:48:20 | Building catalog
Encountered an error:
Database Error
  Access Denied: Table fh-bigquery:INFORMATION_SCHEMA.SCHEMATA: User does not have permission to query table fh-bigquery:INFORMATION_SCHEMA.SCHEMATA.

3. Fix errant SQL

   • Once I got this to run, I found this error.

4. Use simpler incremental logic

   • This works as expected. Not sure if there's a reason you went the other way here!

[fhoffa]

So I'm using this weird complex logic because one of these queries is much better for BigQuery:

• SELECT * FROM * WHERE _table_suffix < '2019_01'
• SELECT * FROM * WHERE _table_suffix < (SELECT date FROM ...)

One is a constant and will prune how much data is read. The other one is variable, and BigQuery doesn't optimize it as well.

I can get that as a constant by using run_query(). I have another option, but it doesn't work now (dbt-labs/dbt-core#2136)