Skip to content

Commit

Permalink
updated for datafusion release 43.0.0
Browse files Browse the repository at this point in the history
  • Loading branch information
pmcgleenon committed Nov 14, 2024
1 parent 95ac971 commit 30fa096
Show file tree
Hide file tree
Showing 4 changed files with 6 additions and 4 deletions.
2 changes: 1 addition & 1 deletion datafusion/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ The benchmark should be completed in under an hour. On-demand pricing is $0.6 pe
1. `cd ClickBench/datafusion`
1. `vi benchmark.sh` and modify following line to target Datafusion version
```
git checkout 40.0.0
git checkout 43.0.0
```
1. `bash benchmark.sh`
Expand Down
2 changes: 1 addition & 1 deletion datafusion/benchmark.sh
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ sudo yum install gcc -y
# Install DataFusion main branch
git clone https://github.com/apache/arrow-datafusion.git
cd arrow-datafusion/datafusion-cli
git checkout 40.0.0
git checkout 43.0.0
CARGO_PROFILE_RELEASE_LTO=true RUSTFLAGS="-C codegen-units=1" cargo build --release
export PATH="`pwd`/target/release:$PATH"
cd ../..
Expand Down
3 changes: 2 additions & 1 deletion datafusion/create_partitioned.sql
Original file line number Diff line number Diff line change
@@ -1,3 +1,4 @@
CREATE EXTERNAL TABLE hits
STORED AS PARQUET
LOCATION 'partitioned';
LOCATION 'partitioned'
OPTIONS ('binary_as_string' 'true');
3 changes: 2 additions & 1 deletion datafusion/create_single.sql
Original file line number Diff line number Diff line change
@@ -1,3 +1,4 @@
CREATE EXTERNAL TABLE hits
STORED AS PARQUET
LOCATION 'hits.parquet';
LOCATION 'hits.parquet'
OPTIONS ('binary_as_string' 'true');

0 comments on commit 30fa096

Please sign in to comment.