DuneSQL Migration: new macros, new dunesql CI, and translated + legacy evms_blocks model#3570

Merged

couralex6 merged 41 commits intomainfrom trino-macros

Jun 27, 2023

+374-245

Commits on Jun 27, 2023

create schema macro for trino

Alex Courouble
authored and
couralex6
committed
trino create table

Alex Courouble
authored and
couralex6
committed
Adds a translated spell to test trino selector

Alex Courouble
authored and
couralex6
committed
changes tag name

Alex Courouble
authored and
couralex6
committed
Adds exclude tag names from CI workflow definition

Alex Courouble
authored and
couralex6
committed
Adds missing comma

Alex Courouble
authored and
couralex6
committed
Run alter table on every run

Alex Courouble
authored and
couralex6
committed
Adds delta_prod as database for source

Alex Courouble
authored and
couralex6
committed
DBT macro to override source database

Alex Courouble
authored and
couralex6
committed
Only add delta_prod to source if we are running on trino

Alex Courouble
authored and
couralex6
committed
Updates expose spell and mark as spell macros

Alex Courouble
authored and
couralex6
committed
Jonas' comments

Alex Courouble
authored and
couralex6
committed
revert uniswap changes

Alex Courouble
authored and
couralex6
committed
Adds dbt trino to pipfile

Alex Courouble
authored and
couralex6
committed
alter view fix

Alex Courouble
authored and
couralex6
committed
adds dunesql tag to evms_blocks model

Alex Courouble
authored and
couralex6
committed
use tags instead of env var in macros to detect dunesql models

Alex Courouble
authored and
couralex6
committed
Adds legacy evms_block file which contains the original spark model

Alex Courouble
authored and
couralex6
committed
Add dbt matrix strategy for spark and dunesql

a-monteiro
authored and
couralex6
committed
Add alias macro

Alex Courouble
authored and
couralex6
committed
Use alias macro in evms blocks

Alex Courouble
authored and
couralex6
committed
Fix select/excludes

a-monteiro
authored and
couralex6
committed
Run sequentially

a-monteiro
authored and
couralex6
committed
Fix exclude tag

a-monteiro
authored and
couralex6
committed
Test fix for broken spark selector

Alex Courouble
authored and
couralex6
committed
fixing bug where compile on spark had an empty select flag

Alex Courouble
authored and
couralex6
committed
Refactor dbt compile

a-monteiro
authored and
couralex6
committed
Updates commit manifest action to generate both dunsql and spark manifests

Alex Courouble
authored and
couralex6
committed
Download manifest from correct location for dunesql runs

Alex Courouble
authored and
couralex6
committed
simplifies copy manifest logic

Alex Courouble
authored and
couralex6
committed
only run dunesql

Alex Courouble
authored and
couralex6
committed
Fix commit manifest target location

Alex Courouble
authored and
couralex6
committed
dunesql_check CI fix

Alex Courouble
authored and
couralex6
committed
Only select state:new,tag:dunesql

jkylling
authored and
couralex6
committed
Move comma inside of $TAG. state:modified != state:modified,

jkylling
authored and
couralex6
committed
Removes 'or True' from expose_spell and mark_as_spell macros prior to merging

Alex Courouble
authored and
couralex6
committed
Test CI run on different s3 location

Alex Courouble
authored and
couralex6
committed
Revert "Test CI run on different s3 location"

Alex Courouble
authored and
couralex6
committed
prod s3 bucket

Alex Courouble
authored and
couralex6
committed
trailing /

Alex Courouble
authored and
couralex6
committed
Prod location again

Alex Courouble
authored and
couralex6
committed