Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Draft] Full filestore refactor w/ SQLite3 #35

Draft
wants to merge 33 commits into
base: develop
Choose a base branch
from
Draft

[Draft] Full filestore refactor w/ SQLite3 #35

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
33 commits
Select commit Hold shift + click to select a range
e598fe1
Adding support for archive formats 6 and 7
Katilith Mar 14, 2022
83d2106
Fixing bugs with the new formats
Katilith Mar 14, 2022
cc2f61e
Adding support for archives 16-28 (until game build 582)
Katilith Mar 14, 2022
2e0721a
Adding archive 29 support and fixing the readme
Katilith Mar 14, 2022
fde2f98
Adding support for configurable config group names
Katilith Mar 20, 2022
07557b7
Bump minimist from 1.2.5 to 1.2.6
dependabot[bot] Jun 13, 2022
2562060
Merge pull request #1 from runejs/dependabot/npm_and_yarn/minimist-1.2.6
SchauweM Jun 13, 2022
0e58044
Working to implement a simpler file-system/store approach
Katilith Jul 12, 2022
2520636
Implementing js5 main index encoding and changing some variable names
Katilith Jul 12, 2022
df2a688
Removing old filestore-system files and reorganizing the new package
Katilith Jul 12, 2022
108a798
Changing the packed/ dir to js5/ and the indexes/ dir to index/
Katilith Jul 12, 2022
9fbe8eb
Getting the basic js5 indexing system working and writing to SQLite DB
Katilith Jul 14, 2022
abf8198
Implementing filestore index loading and fixing some JS5 decode issues
Katilith Jul 14, 2022
8cebf95
Adding validation for checksum, shaDigest, fileSize, compressed versi…
Katilith Jul 17, 2022
95e7e9e
Fixing childCount database column name
Katilith Jul 17, 2022
9818569
Working on adding support for Jag Cache stores (builds 234-399)
Katilith Jul 18, 2022
4b13554
Adding the ability to pull data/caches from OpenRS2.org if they're fo…
Katilith Jul 20, 2022
12e244b
XTEA keys will now be fetched from OpenRS2.org, if none are found the…
Katilith Jul 20, 2022
ddd98bf
Porting over JS5 archive and group encoding in preparation for flat f…
Katilith Jul 21, 2022
f70e4ad
Working on JAG format cache decoding and indexing - about 50% completed
Katilith Aug 2, 2022
74969f2
Moving Jag format index entities to their own table structure and ref…
Katilith Aug 8, 2022
ba0bccc
Adding missing file name/namehashes for caches 274 and 289 - hunt.dat…
Katilith Aug 8, 2022
d073b3d
Finishing up JAG cache indexing by adding the remaining missing DB fi…
Katilith Aug 8, 2022
2a1943e
Prototyping out some parsers & decoders for JAG format files
Katilith Aug 12, 2022
4c5728a
Stubbing out some JAG game interface decoder code
Katilith Aug 12, 2022
c1037f7
Prototyping JAG interface decoding. Also adds support for JAG index e…
Katilith Aug 13, 2022
e1b775f
Implementing JAG interface decoding and saving within JAG databases
Katilith Aug 15, 2022
3a33c22
Reimplementing Js5 http server support for the webclient project
Katilith Aug 22, 2022
072eeb9
Updating to the latest /common 3.0.0 beta version and applying fixes
Katilith Aug 24, 2022
c8a75e7
Improving the HTTP server using decorators with full support for all …
Katilith Aug 29, 2022
907d7ec
Moving JS5 uncompressed and compressed file data into separate tables…
Katilith Aug 29, 2022
1e0b45e
Merging uncompressed and compressed data tables + adding archive-conf…
Katilith Sep 1, 2022
d63f842
Moving JAG file data out to another table like JS5 and fixing tons of…
Katilith Sep 4, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 4 additions & 3 deletions .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,10 +1,11 @@
/unpacked/
packed/*
js5/*
/lib/
/temp/
/tmp/
config/xtea/*
/indexes/
indexes/*
index/*
/logs/


Expand All @@ -26,4 +27,4 @@ yarn-error.log*
*.sln
*.sw?

!packed/.gitkeep
!js5/.gitkeep
21 changes: 16 additions & 5 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,15 +7,13 @@
Node tools for managing and indexing the JS5 file store used with RuneJS.

## CLI Tools
_@todo work in progress_

- `index`
- `unpack`

## Archives
_@todo work in progress_

### JS5 // Game Version 400+
### JS5 File Store // Game Builds 400-604

| Key | Archive Name | Content Description | File Format | Build |
|----------------------------------:|:-----------------|:----------------------------------|:-----------:|:-----------------:|
Expand All @@ -33,8 +31,21 @@ _@todo work in progress_
| <sub><sup>idx</sup></sub> **9** | textures | Game Textures | | _400_<sup>+</sup> |
| <sub><sup>idx</sup></sub> **10** | binary | Miscellaneous Binary Files | | _400_<sup>+</sup> |
| <sub><sup>idx</sup></sub> **11** | midi_jingles | Shorter Midi Jingles | .mid | _400_<sup>+</sup> |
| | | | | |
| <sub><sup>idx</sup></sub> **12** | clientscripts | Client Script (CS2) Files | .cs2 | _435_<sup>+</sup> |
| <sub><sup>idx</sup></sub> **13** | fontmetrics | Game Font Metrics | | _443_<sup>+</sup> |
| <sub><sup>idx</sup></sub> **14** | vorbis | Vorbis Sound Files | .ogg | _451_<sup>+</sup> |
| <sub><sup>idx</sup></sub> **14** | vorbis | Vorbis Sound Files | | _451_<sup>+</sup> |
| <sub><sup>idx</sup></sub> **15** | midi_instruments | Midi Song Instruments | | _451_<sup>+</sup> |
| <sub><sup>idx</sup></sub> **16** | config_loc | Location Object Configs | | _489_<sup>+</sup> |
| <sub><sup>idx</sup></sub> **17** | config_enum | Enum Configs | | _489_<sup>+</sup> |
| <sub><sup>idx</sup></sub> **18** | config_npc | NPC Configs | | _489_<sup>+</sup> |
| <sub><sup>idx</sup></sub> **19** | config_obj | Item Object Configs | | _489_<sup>+</sup> |
| <sub><sup>idx</sup></sub> **20** | config_seq | Animation Sequence Configs | | _489_<sup>+</sup> |
| <sub><sup>idx</sup></sub> **21** | config_spot | Graphical Spot Animation Configs | | _489_<sup>+</sup> |
| <sub><sup>idx</sup></sub> **22** | config_var_bit | VarBit Configs | | _489_<sup>+</sup> |
| <sub><sup>idx</sup></sub> **23** | worldmapdata | In-Game World Map Data | | _493_<sup>+</sup> |
| <sub><sup>idx</sup></sub> **24** | quickchat | Quickchat Data | | _498_<sup>+</sup> |
| <sub><sup>idx</sup></sub> **25** | quickchat_global | Global Quickchat Data | | _498_<sup>+</sup> |
| <sub><sup>idx</sup></sub> **26** | materials | Materials | | _500_<sup>+</sup> |
| <sub><sup>idx</sup></sub> **27** | config_particle | Particle Configs | | _523_<sup>+</sup> |
| <sub><sup>idx</sup></sub> **28** | defaults | Defaults | | _537_<sup>+</sup> |
| <sub><sup>idx</sup></sub> **29** | billboards | Billboards | | _582_<sup>+</sup> |
129 changes: 0 additions & 129 deletions config/archives.json5
View file
Open in desktop

This file was deleted.

Loading