Release version 0.12.0 #873

risdenk · 2016-11-15T17:13:55Z

This release is a bit overdue. There hasn't been much activity in the past few weeks as far as things being merged. I plan to cut the staging branch on Wednesday afternoon ~36hrs from now.

I'll also publish the change list going into this release and put out a request for volunteers to test it.

With next week being Thanksgiving in the US, that gives the Thursday/Friday this week and a few days next week for testing. If testing goes well we can release around 12/1.

risdenk · 2016-11-15T17:23:09Z

Here is the list of components/bindings that have changed in this release:

[azuretablestorage] Add Azure table storage #837 [azuretablestorage] - Added Azure Table Storage binding
add sigar-dist dependency for maven test on Cassandra 2.2+ and tracing function #776,[cassandra] Increase Cassandra test timeout and add logging for test failures #850 [cassandra] - Test fixes - Sigar test dependency and logging
Support for configurable fractional percentile metrics in output file... #863 [core] - Support fractional percentile metrics in output format
[googledatastore] Upgrade googledatastore API from v1beta3 to v1. #833 [googledatastore] - Upgrade to version v1
[jdbc] Assorted cleanup/fixes around batching and supporting different databases #842,Update README and sample config file for jdbc #872 [jdbc] - JDBC fixes
[orientdb] OrientDB was updated to 2.2.10 and bugs fixed #848 [orientdb] - Upgrade to 2.2.10 and multithreading bug fixes
Added Rest Client Module to benchmark Restful Web Services #756 [rest] - Added REST web services binding
[solr] Upgrade Solr binding to 5.5.3 #847 [solr] - Upgrade to 5.5.3
[solr,solr6] Add Solr 6 binding #849 [solr6] - Add Solr 6 binding
[packaging] Fix distribution of bindings.properties #852 [packaging] - Fix distribution of bindings.properties
[build, core, accumulo, couchbase2, hbase10, orientdb] fixes for jdk9 #712,[jdbc, solr] Fix JDBC checkstyle and skip Solr 5.x with JDK 9 #854 JDK 9 support fixes

risdenk · 2016-11-15T17:24:05Z

Bindings that should be tested:

risdenk · 2016-11-15T17:25:58Z

Tentative release plan:

RC1 will be cut: Fri Nov 18
Testing can begin: Fri Nov 18
Testing complete: Wed Dec 7

risdenk · 2016-11-18T15:35:28Z

RC1 is out: https://github.com/brianfrankcooper/YCSB/releases/tag/0.12.0-RC1

shivam-maharshi · 2016-11-27T19:36:49Z

@risdenk While running this command: {fullpath}/bin/ycsb.bat run rest -s -P workloads/workload_rest, I received the error below:

Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/htrace/core/HTraceConfiguration
        at com.yahoo.ycsb.Client.main(Client.java:947)
Caused by: java.lang.ClassNotFoundException: org.apache.htrace.core.HTraceConfiguration
        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        ... 1 more

Any suggestions?

risdenk · 2016-11-28T16:40:58Z

@shivam-maharshi hmmm I see the same with

./bin/ycsb.sh run rest -s -P ./rest/src/test/resources/workload_rest

I don't get an error when I try with:

./bin/ycsb run rest -s -P ./rest/src/test/resources/workload_rest

Looks like there might be an issue with ycsb.sh and ycsb.bat resolving the classpath.

risdenk · 2016-11-28T17:18:35Z

@shivam-maharshi the issue is that the core module dependencies aren't included in a source checkout when using ycsb.sh or ycsb.bat. There isn't a lib or dependency directory for the core module after packaging. It should work if you build YCSB and extract a distribution.

yuyantingzero · 2016-11-28T18:36:10Z

googledatastore looks good, thanks!

risdenk · 2016-11-28T19:50:36Z

Thanks @yuyantingzero for testing googledatastore!

risdenk · 2016-12-01T01:21:15Z

@shivam-maharshi - Any update on testing the rest binding?
@xiangcong - Can you check the azuretablestorage binding?
@Laa - Can you check the orientdb binding?

risdenk · 2016-12-01T01:21:55Z

Since the testing hasn't been completed yet, going to push out testing deadline to 12/5. Then release next week if possible.

joshelser · 2016-12-01T04:04:37Z

@risdenk JDBC looks fine to me. Poked around with MySQL and Apache Phoenix. Thanks for putting the RC together!

xiangcong · 2016-12-01T12:09:21Z

@risdenk
I successfully ran "mvn -pl com.yahoo.ycsb:azuretablestorage-binding -am clean package"
and then when I ran "./bin/ycsb load azuretablestorage ......"

It reported errors as follow:

Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/htrace/core/HTraceConfiguration
        at com.yahoo.ycsb.Client.main(Client.java:947)
Caused by: java.lang.ClassNotFoundException: org.apache.htrace.core.HTraceConfiguration
        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        ... 1 more

According to your suggestion of building YCSB, I tried to ran "mvn package" , but it failed with the error

"[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.8:test (default-test) on project cassandra-binding: There are test failures."

any suggestion?
Thanks~

risdenk · 2016-12-01T21:41:11Z

@xiangcong did you run with ./bin/ycsb or ./bin/ycsb.sh? I haven't had issues with ./bin/ycsb see #877 for source checkout ycsb.sh|cmd issue. Instead of just package you would need to build the distribution and extract I'm pretty sure.

risdenk · 2016-12-01T21:43:19Z

Thanks for testing the jdbc-binding @joshelser!

shivam-maharshi · 2016-12-01T21:51:49Z

@risdenk I tried building the zip with this command - mvn clean package but it fails at Cassandra binding every time. I have a windows machine.

xiangcong · 2016-12-02T02:23:43Z

@risdenk
Thanks for your suggestion and test is done!
It's ok for azuretablestorage binding.

risdenk · 2016-12-02T15:29:19Z

Thanks @xiangcong for checking the azuretablestorage binding!

risdenk · 2016-12-02T15:30:08Z

@shivam-maharshi hmmmm can you share more of the Cassandra test output? Open a new ticket and link to here. In the meantime you should be able to build with mvn clean package -DskipTests.

risdenk · 2016-12-02T23:19:40Z

Tested solr and solr6 bindings. Details on the commands run are below for reference.

solr binding

docker run --rm -p 8983:8983 solr:5-alpine solr-create -c ycsb
curl -X POST -H 'Content-type:application/json' --data-binary '{"add-field":{"name":"field0","type":"text_general","indexed":"true","stored":"true"},"add-field":{"name":"field1","type":"text_general","indexed":"true","stored":"true"},"add-field":{"name":"field2","type":"text_general","indexed":"true","stored":"true"},"add-field":{"name":"field3","type":"text_general","indexed":"true","stored":"true"},"add-field":{"name":"field4","type":"text_general","indexed":"true","stored":"true"},"add-field":{"name":"field5","type":"text_general","indexed":"true","stored":"true"},"add-field":{"name":"field6","type":"text_general","indexed":"true","stored":"true"},"add-field":{"name":"field7","type":"text_general","indexed":"true","stored":"true"},"add-field":{"name":"field8","type":"text_general","indexed":"true","stored":"true"},"add-field":{"name":"field9","type":"text_general","indexed":"true","stored":"true"}}' http://localhost:8983/solr/ycsb/schema
./bin/ycsb load solr -s -P workloads/workloada -p table=ycsb -p recordcount=100 -p operationcount=100
./bin/ycsb run solr -s -P workloads/workloada -p table=ycsb -p recordcount=100 -p operationcount=100

solr6 binding

docker run --rm -p 8983:8983 solr:6-alpine solr-create -c ycsb
curl -X POST -H 'Content-type:application/json' --data-binary '{"add-field":{"name":"field0","type":"text_general","indexed":"true","stored":"true"},"add-field":{"name":"field1","type":"text_general","indexed":"true","stored":"true"},"add-field":{"name":"field2","type":"text_general","indexed":"true","stored":"true"},"add-field":{"name":"field3","type":"text_general","indexed":"true","stored":"true"},"add-field":{"name":"field4","type":"text_general","indexed":"true","stored":"true"},"add-field":{"name":"field5","type":"text_general","indexed":"true","stored":"true"},"add-field":{"name":"field6","type":"text_general","indexed":"true","stored":"true"},"add-field":{"name":"field7","type":"text_general","indexed":"true","stored":"true"},"add-field":{"name":"field8","type":"text_general","indexed":"true","stored":"true"},"add-field":{"name":"field9","type":"text_general","indexed":"true","stored":"true"}}' http://localhost:8983/solr/ycsb/schema
./bin/ycsb load solr6 -s -P workloads/workloada -p table=ycsb -p recordcount=100 -p operationcount=100
./bin/ycsb run solr6 -s -P workloads/workloada -p table=ycsb -p recordcount=100 -p operationcount=100

shivam-maharshi · 2016-12-05T06:24:50Z

@risdenk

Issue created: #880

After skipping test the build was a success but while running rest-module I still received the same error as before. Please find the details below.

Build status

[INFO] YCSB Root .......................................... SUCCESS [  1.838 s]
[INFO] Core YCSB .......................................... SUCCESS [ 29.808 s]
[INFO] Per Datastore Binding descriptor ................... SUCCESS [  0.588 s]
[INFO] YCSB Datastore Binding Parent ...................... SUCCESS [  0.829 s]
[INFO] Accumulo DB Binding ................................ SUCCESS [ 15.000 s]
[INFO] Aerospike DB Binding ............................... SUCCESS [  1.756 s]
[INFO] ArangoDB Binding ................................... SUCCESS [  2.463 s]
[INFO] AsyncHBase Client Binding for Apache HBase ......... SUCCESS [  9.211 s]
[INFO] Azure table storage Binding ........................ SUCCESS [  1.960 s]
[INFO] Cassandra 2.1+ DB Binding .......................... SUCCESS [  4.440 s]
[INFO] Couchbase Binding .................................. SUCCESS [  2.408 s]
[INFO] Couchbase Java SDK 2.x Binding ..................... SUCCESS [  2.902 s]
[INFO] DynamoDB DB Binding ................................ SUCCESS [ 52.244 s]
[INFO] Elasticsearch Binding .............................. SUCCESS [ 26.855 s]
[INFO] Geode DB Binding ................................... SUCCESS [ 31.933 s]
[INFO] Google Cloud Datastore Binding ..................... SUCCESS [  8.067 s]
[INFO] Google Cloud Bigtable Binding ...................... SUCCESS [ 10.781 s]
[INFO] HBase 0.98.x DB Binding ............................ SUCCESS [ 19.010 s]
[INFO] HBase 0.94.x DB Binding ............................ SUCCESS [ 38.895 s]
[INFO] HBase 1.0 DB Binding ............................... SUCCESS [  7.981 s]
[INFO] Hypertable DB Binding .............................. SUCCESS [  4.474 s]
[INFO] Infinispan DB Binding .............................. SUCCESS [ 10.567 s]
[INFO] JDBC DB Binding .................................... SUCCESS [  8.548 s]
[INFO] Kudu DB Binding .................................... SUCCESS [  7.706 s]
[INFO] memcached binding .................................. SUCCESS [  3.379 s]
[INFO] MongoDB Binding .................................... SUCCESS [  5.562 s]
[INFO] Oracle NoSQL Database Binding ...................... SUCCESS [  3.134 s]
[INFO] OrientDB Binding ................................... SUCCESS [  5.785 s]
[INFO] rados of Ceph FS binding ........................... SUCCESS [  3.093 s]
[INFO] Redis DB Binding ................................... SUCCESS [  2.438 s]
[INFO] Rest Client Binding ................................ SUCCESS [  5.033 s]
[INFO] Riak KV Binding .................................... SUCCESS [  5.327 s]
[INFO] S3 Storage Binding ................................. SUCCESS [  2.750 s]
[INFO] Solr Binding ....................................... SUCCESS [ 44.800 s]
[INFO] Solr 6 Binding ..................................... SUCCESS [ 42.324 s]
[INFO] Tarantool DB Binding ............................... SUCCESS [  1.507 s]
[INFO] YCSB Release Distribution Builder .................. SUCCESS [ 18.236 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 07:24 min
[INFO] Finished at: 2016-12-05T01:19:25-05:00
[INFO] Final Memory: 153M/779M
[INFO] ------------------------------------------------------------------------

The error while running rest module:

C:\Users\Sam\Downloads\YCSB-0.12.0-RC1>C:/Users/Sam/Downloads/YCSB-0.12.0-RC1/bin/ycsb.bat run rest -s -P workloads/workload_rest

C:\Users\Sam\Downloads\YCSB-0.12.0-RC1>"C:\Program Files\Java\jdk1.8.0_60\bin\java.exe"  -classpath "C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\conf;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\core\target\core-0.12.0-RC1.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\rest-binding-0.12.0-RC1.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\aopalliance-repackaged-2.2.0.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\commons-codec-1.9.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\commons-logging-1.2.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\ecj-4.4.2.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\hk2-api-2.2.0.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\hk2-locator-2.2.0.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\hk2-utils-2.2.0.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\httpclient-4.5.1.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\httpcore-4.4.4.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\javassist-3.18.1-GA.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\javax.annotation-api-1.2.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\javax.inject-2.2.0.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\javax.ws.rs-api-2.0.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\jersey-client-2.6.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\jersey-common-2.6.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\jersey-container-servlet-core-2.6.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\jersey-guava-2.6.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\jersey-server-2.6.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\osgi-resource-locator-1.0.1.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\system-rules-1.16.0.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\tomcat-dbcp-8.0.28.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\tomcat-embed-core-8.0.28.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\tomcat-embed-el-8.0.28.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\tomcat-embed-jasper-8.0.28.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\tomcat-embed-logging-juli-8.0.28.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\tomcat-embed-logging-log4j-8.0.28.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\tomcat-embed-websocket-8.0.28.jar;C:\Users\Sam\Downloads\YCSB-0.12.0-RC1\rest\target\dependency\validation-api-1.1.0.Final.jar" com.yahoo.ycsb.Client -t -db com.yahoo.ycsb.webservice.rest.RestClient -s -P workloads/workload_rest
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/htrace/core/HTraceConfiguration
        at com.yahoo.ycsb.Client.main(Client.java:947)
Caused by: java.lang.ClassNotFoundException: org.apache.htrace.core.HTraceConfiguration
        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        ... 1 more

Any suggestions what can I do to circumvent this?

risdenk · 2016-12-05T16:04:16Z

@shivam-maharshi if you really want to use bin/ycsb.bat instead of bin/ycsb you need to extract the tar.gz from the distribution/target folder after building and then use it.

shivam-maharshi · 2016-12-06T15:09:18Z

@risdenk that worked! I verified the rest-binding and it worked perfectly well. Thanks for creating the RC!

risdenk · 2016-12-07T05:08:00Z

Thanks @shivam-maharshi for testing the rest-binding!

risdenk · 2016-12-12T15:42:29Z

I checked OrientDB and didn't find any issues there either. I'll get to the release notes and finish out the release today.

risdenk · 2016-12-12T21:12:06Z

Here are the draft release notes: https://gist.github.com/risdenk/483fba8c7469f717239bf133ce98ebc8

Can someone please review? Thanks!

joshelser · 2016-12-12T21:17:20Z

👍

risdenk · 2016-12-12T21:18:55Z

Thanks @joshelser! I'll work through the remaining release steps.

shivam-maharshi · 2016-12-12T21:43:07Z

👍

risdenk · 2016-12-12T21:58:44Z

Release it out: https://github.com/brianfrankcooper/YCSB/releases/tag/0.12.0

risdenk self-assigned this Nov 15, 2016

risdenk added the release label Nov 15, 2016

risdenk mentioned this issue Nov 28, 2016

ycsb.sh and ycsb.bat don't work from source checkout #877

Closed

risdenk closed this as completed Dec 23, 2016

busbey mentioned this issue Apr 27, 2018

[cassandra] Update CassandraCQLClient to use PreparedStatement for better performance #1051

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Release version 0.12.0 #873

Release version 0.12.0 #873

risdenk commented Nov 15, 2016

risdenk commented Nov 15, 2016 •

edited

Loading

risdenk commented Nov 15, 2016 •

edited by manolama

Loading

risdenk commented Nov 15, 2016 •

edited

Loading

risdenk commented Nov 18, 2016

shivam-maharshi commented Nov 27, 2016

risdenk commented Nov 28, 2016

risdenk commented Nov 28, 2016

yuyantingzero commented Nov 28, 2016

risdenk commented Nov 28, 2016

risdenk commented Dec 1, 2016

risdenk commented Dec 1, 2016

joshelser commented Dec 1, 2016 •

edited

Loading

xiangcong commented Dec 1, 2016 •

edited by risdenk

Loading

risdenk commented Dec 1, 2016

risdenk commented Dec 1, 2016

shivam-maharshi commented Dec 1, 2016

xiangcong commented Dec 2, 2016

risdenk commented Dec 2, 2016

risdenk commented Dec 2, 2016

risdenk commented Dec 2, 2016

shivam-maharshi commented Dec 5, 2016 •

edited by risdenk

Loading

risdenk commented Dec 5, 2016

shivam-maharshi commented Dec 6, 2016

risdenk commented Dec 7, 2016

risdenk commented Dec 12, 2016

risdenk commented Dec 12, 2016

joshelser commented Dec 12, 2016

risdenk commented Dec 12, 2016

shivam-maharshi commented Dec 12, 2016

risdenk commented Dec 12, 2016

Release version 0.12.0 #873

Release version 0.12.0 #873

Comments

risdenk commented Nov 15, 2016

risdenk commented Nov 15, 2016 • edited Loading

risdenk commented Nov 15, 2016 • edited by manolama Loading

risdenk commented Nov 15, 2016 • edited Loading

risdenk commented Nov 18, 2016

shivam-maharshi commented Nov 27, 2016

risdenk commented Nov 28, 2016

risdenk commented Nov 28, 2016

yuyantingzero commented Nov 28, 2016

risdenk commented Nov 28, 2016

risdenk commented Dec 1, 2016

risdenk commented Dec 1, 2016

joshelser commented Dec 1, 2016 • edited Loading

xiangcong commented Dec 1, 2016 • edited by risdenk Loading

risdenk commented Dec 1, 2016

risdenk commented Dec 1, 2016

shivam-maharshi commented Dec 1, 2016

xiangcong commented Dec 2, 2016

risdenk commented Dec 2, 2016

risdenk commented Dec 2, 2016

risdenk commented Dec 2, 2016

shivam-maharshi commented Dec 5, 2016 • edited by risdenk Loading

risdenk commented Dec 5, 2016

shivam-maharshi commented Dec 6, 2016

risdenk commented Dec 7, 2016

risdenk commented Dec 12, 2016

risdenk commented Dec 12, 2016

joshelser commented Dec 12, 2016

risdenk commented Dec 12, 2016

shivam-maharshi commented Dec 12, 2016

risdenk commented Dec 12, 2016

risdenk commented Nov 15, 2016 •

edited

Loading

risdenk commented Nov 15, 2016 •

edited by manolama

Loading

risdenk commented Nov 15, 2016 •

edited

Loading

joshelser commented Dec 1, 2016 •

edited

Loading

xiangcong commented Dec 1, 2016 •

edited by risdenk

Loading

shivam-maharshi commented Dec 5, 2016 •

edited by risdenk

Loading