-
Notifications
You must be signed in to change notification settings - Fork 8
/
Copy pathCHANGELOG
293 lines (293 loc) · 14.9 KB
/
CHANGELOG
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
2010-01-06
1) Parameters naming changed (-t,-s).
2) Mac list intersection solved (test/intersect.py).
2010-01-08
1) Add --no-dump parameter with no log file writting.
2) Mod MAC:RSS output format under verbose mode.
2010-01-13
1) Add online location fingerprinting routine.
2010-01-14
1) Mod returned spid,rss structure, and the final computation of the KNN location.
2) Add run test script
3) Mod online location result output format.
4) Fix ary_kmin array reshape error when there are not enough KNN fingerprints.
5) Opt WLAN scanned AP number less than INTERSIZE.
2010-01-16
1) Add multiple fake GPS mode(home/cmri,etc) handling in online phase.
2) Add concise address information support.
2010-01-17
1) Update issue 5: interset solution error when strongest AP is not in radio map.
2) Fix issue 5: break -> continue.
3) Mod fake WLAN data config.py.
2010-01-20
1) Fix MAC:RSS descending order sorted based on RSS values for Radio map file generation.
2010-01-21
1) Mod offline RadioMap(), only certain number(INTERSIZE) of max-rss APs left in radio map fingerprints.
2) Fix logical procedure bug for maxmacs generation, introduced by REV<e65c339eeb>.
3) Fix appending error for rss_scan_dist, introduced by using maxmacs instead of mac_inter.
4) Fix onopts bug in run script, introduced by REV<5bc8b654fd>.
2010-01-22
1) Add offline clustering heuristics.
2010-01-24
1) Clustering heuristics implementation: Cluster(rmpfile). The circumstance that fingerprint's APs included in member of sets_keyaps list should be considered.
2010-01-25
1) KML interface agile development for sampling and location point demonstration.
2010-01-26
1) KML related data structure specification and function encapsulation.
2) Clear up clustering heuristics.
3) mod KML __main__ to contain testing data in dat/ap.dat, which should be deleted.
2010-01-27
1) Data organization for two designated sql tables(cid_aps,cfps) in clustering routine.
2010-01-28
1) Add MySQLdb interface for clustered fingerprints uploading into database tables.
2010-01-29
1) Opt code trimming and efficiency of maxmacs and maxrsss construction routine with vectorized operation.
2) Add online db operation and immature data processing for location fingerprinting.
2010-02-01
1) bare bone implementation of online processing.
2010-02-02
1) Fix issue 7 by re-arranging RSSs according to key MACs in table 'cfps'.
2010-02-03
1) Merge opt online list atof operation for keyrsss and todo list updating.
2010-02-04
1) Update tbl data after offline calibration, filtering, clustering and sql importing.
2) Unclustered fingerprints spid printing in offline procedure.
3) Coherent offline processing support in run -n <start_spid> argument.
2010-02-05
1) Fix issue 10 for maxmacs subset-searching in fingerprints.
2) Fix goon assignment error in run script.
2010-02-07
1) Fix bug when wlan len == 0.
2) Fix bug when subset searching fails.
3) Mod trimming imported file handling related parameters.
2010-02-08
1) Add *nix kernel syscall method for WLAN AP scanning.
2010-02-09
1) Fix exception handling bug in scanWLAN_OS() of WLAN module.
2) Exception handling for GPS module.
2010-02-10
1) Fix RSS calculation error(minus 256) in scanWLAN_OS() of WLAN module.
2) Update TODO list.
2010-02-11
1) Fix issue 11, fast fix when ONLY 1 cluster selected in 'cidaps' has ONLY 1 spid selected in 'cfps'.
2) Clean up online file related code, backward support terminated.
3) Opt data organization for DB config: store data in dicts.
2010-02-12
1) Add db_config import in offline routine as what online does.
2010-02-20
1) Fix robustness bug for optimizing intersection size by sorting and indexing intersection size list of all clusters, instead of using defected loop.
2) Fix issue 14 when interpart_offline=True, however interpart_online=False.
3) Fix minor print formating bug when keycfps has more than 1 element.
2010-02-21
1) Add KML generation routine for pinpointing offline sampling points.
2010-02-25
1) Fix issue 15 for 'interpart_online' is true with more than one overlapping macs.
2) Add exception handling for root permission error(errno.EPERM).
2010-02-26
1) Add dumb test in run script with support for redirecting stdout, stderr to different logs.
2) Mod fake WLAN_FAKE id.
2010-02-27
1) Add exception handling for key looking up in dict WLAN_FAKE.
2010-02-28
1) Mod solution of maxrsss thru array.astype(int) instead of list comprehension.
2) Opt DKNN location fix process.
2010-03-01
1) Fix CLUSTERKEYSIZE restriction on the number of offline visible APs.
2) Add functionalization for getWLAN(). Combine maxmacs/maxrsss into one array:wlan.
3) Fix date/timestamp fusion, fakegps init value and option error in run.
2010-03-02
1) Add test module for verification of algo performance.
2) Add fixPos() with uniformed returned loc, peel off getWLAN(), and rm global vars in online module.
3) Add ExtGPS data source connection script: bt-dev-con.
4) Add pyc compileall option '-m' for run.
5) Update and Fix issue 16.
2010-03-04
1) Add distance calculation between refloc and fixloc in test module.
2) reAdd CLUSTERKEYSIZE limit on number of APs for radio map generation.
3) Fix bt-dev-con grep bug.
2010-03-06
1) Add 'title' field in KML input data mandatory section.
2) Add Google Map js interface wrapper.
2010-03-08
1) Mod Map module.
2010-03-09
1) Fix issue 17 for mismatching relation between GMap.icons and map.points.iconids.
2) Fix height computation error for multiple maps.
2010-03-14
1) Add shapefile handling code.
2) Refactor shapefile handling code to be OO.
2010-03-15
1) Mod Shapefile class, finished shape types: Null, Point, PolyLine, Polygon, MultiPoint.
2010-03-16
1) Add Shapefile database file (.dbf) record read methods.
2010-03-23
1) Mod run script to support dumbtest evaluation for (indoor) logical location.
2010-03-24
1) Add statistical evaluation related methods to obtain MEAN, STDEV, CDF, GMap: evalLoc(), testLoc(), drawPointpairs().
2) Add CDF plot support with Gnuplot interface.
2010-03-25
1) Refactor test module for better reuse, effectiveness.
2010-03-26
1) Mod argument list for methods in test module.
2) Fix bug in mp latex term script for gnuplot.
2010-03-28
1) Add GMap makeup method in test module with point pairs in loc file(s).
2) Mod icon style definition for fix/ref point.
3) Add stability loop test for any executable file in CWD, like 'run -s sudo test.py '-t -g -f 1'.
2010-04-02
1) Fix the start index of -e/-m options for test module.
2) Add max print support for getStats().
2010-04-03
1) Fix issue 20 that 'wlan' will be reassigned during the mrsss/sum_rss solution loop.
2010-04-04
1) Fix issue 21 that sorted_sums[:idx_dkmin] bumps into indexing error cos idx_dkmin set to 0 when the minimum of sorted_sums is 0, add side='right' option to searchsorted().
2010-04-06
1) Add featured points in solveCDF(), like points with .67 and .95 probabilities.
2010-04-07
1) Fix xtics bug for CDF plot properties.
2010-04-09
1) Add histogram stats for data sequence.
2) Add err info in gmap popup point tag.
3) Opt func args for test module.
4) Fix logical flow for test module.
5) Fix KWIN searchsorted boundry in the case that min(dknn_sums)=0.
2010-04-11
1) Add matplotlib support for better CDF/histogram plotting.
2010-04-12
1) Fix bug that arg 'pickedX' changed in solveCDF().
2) Add savefig format arg in pyplotCDF().
2010-08-22
1) Fix the returned number of sorted and sliced visible wifis for getWLAN().
2010-08-24
1) Add positioning error estimation algo, with only euclidean distance support.
2010-08-25
1) Fix the numpy.array() error when allpos has different dimensional elements, numpy.array(sequence, object) works whether each cluster has same amount of fingerprints or not.
2) Add support for distance on earth surface for error range estimation.
2010-10-05
1) Add genKML_FPP(): FPP-WPP compatible csv data interpretation and visualisation with KML.
2010-10-14
1) Add xloopscan.py for Symbian based wireless x-scanning with FPP-WPP rawdata format compatibility.
2010-10-24
1) Add oracle & postgresql driver class WppDB, and cidaps/cfps table load functionalities.
2) Add some post-sampling scripts for fpp raw data processing.
2010-10-26
1) Add sql-level query support for offline clustering.
2) Add data picking script for req & db from the same data source.
3) Integrate the program for 14/16 col processing in wppdata_preprocess & cluster() in offline module.
2010-11-04
1) Mod wppeval to implement location quality evaluation comparatively among cpp, py and google geolocation.
2010-11-05
1) Mod evaloc to support offline data analysis, including reqreterr loading & stats for 200m below.
2) Fix calculation for error estimation deviation in evaloc.
3) Fix 1)too large bins; 2)pyplot.close() in dataviz.pyplotCDF().
4) Add HTTP & URL multi-level Exception handling in geolocation_api.getGL()
2010-11-09
1) Add incremental clustering support using db in offilne module.
2) Add Google geolocation cell data fetcher.
2010-11-12
1) Refactor WppDB class for code reuse.
2) Refine output format for geolocation_api module.
2010-11-14
1) Fix verbose mode in online module.
2010-11-17
1) Fix issue 24: mismatch between queried macs/rsss.
2) Refactor main function and relative data structure in evaloc module.
3) Add getIPaddr() for automating network setting in evaloc module.
4) Add pickdiffs tool for picking up different-ep/ee cases from reqreterr datafile.
2010-11-23
1) Fix issue 25: process all fps of K-nearest distances & canceling min of dist in each cluster.
2010-11-24
1) Fix existing bugs for issue 25: when fps_cand only has one element, refining weight vector.
2) Fix bug when dataset is empty in evaloc module.
2011-01-04
1) Fix bug in db.py for postgresql compatibility & table instance
2) Implementing incremental clustering & verification process.
3) Deploy easy-to-use 'hg bug' for issue tracking.
2011-01-05
1) Fix bug 1a: rewrite WppDB._insertMany() to handle loading more than one records using copy from stdin(StringIO) of postgresql.
2) Refactor WppDB.load_table() to reuse _loadFile() & _insertMany() meta methods.
3) Fix bug f: sql query returns the clusters with the same number of aps as the incr fp.
4) Fix bug a: Cluster query error of SQL in getCIDcntMaxSeq().
5) Auto cluster & table upload procedures: All|Incr clustering: offline.py -c 1|2; db.py all|inc.
2011-01-31
1) Implement WSGI server for WPP service, supporting WPP interface API.
2011-02-04
1) Fix bug when WPP req msg has no 'dtd>' line in tool.web.wsgi.wpp_server.
2) Add Apache Benchmark script for cocurrence test in tool/cocur.
2011-02-14
1) Refactor db.WppDB.getBestClusters() API for online fixpos.
2) Update bug list for db API db.WppDB.getBestClusters().
2011-04-30
1) Add offline.syncFtpUprecs
2) Mod wpp_uprecsinfo
3) Add wpp_uprecsver for storing latest sync version.
2011-05-03
1) Add db.setRawdataVersion() for updating rawdata version in wpp_uprecsver.
2) Add email alert when rawdata insert exception happens.
3) Complete the offline updateAlgoData() procedure.
2011-05-05
1) Add wpp_uprecs_noloc table for location unavailable rawdata
2) Opt offline.updateAlgoData procedure
3) Mod format for alert mail.
4) Mod WppDB object to be outside of offline.doClusterIncr().
2011-05-09
1) Fix bug when NO FP of certain version of uprecs has loc info(rdata_loc is None).
2011-05-15
1) Add DB connection pooling for db module with sqlalchemy.
2) Update bug list.
2011-05-29
1) Mod project filesystem structure for package & module management.
2) Refactor WppDB class methods for robust offline & db operations, like: db.loadClusteredData() & offline.loadRawdata() which contains 1)db.initTables();2)offline.doClusterIncr();3)db.updateIndexes()
2011-05-30
1) Add offline.loadRawdata() for importing raw csv file into DB tables, including algo related tables.
2) Fix bug in db._getNewCid() when the wpp_clusteridaps table is empty.
3) Mod exec order of db.updateIndexes() to just follow db.initTables() for speedup.
4) Add command line progressbar support for offline.doClusterIncr().
2011-05-31
1) Abandon old algo that use all the cluster data to do intersection.
2) Speedup system performance by slimming module imports.
2011-06-28
1) Fix db.getRawdataVersion() when |wpp_uprecsver| is null for offline.loadRawdata().
2011-07-18
1) Mod util.geolocation_api.collectCellArea() to add lac info for identifying certain unique cell, schema of sqlite table cell_area: lac|cellid|areacode|areaname.
2011-07-22
1) Refactor logg system to support gunicorn multi-process rotate file central logging.
2) Mod connect_error decorator to sleep in every loop.
2011-07-25
1) Add wpp cell location & google wifi/cell location persistance support.
2) Refactor web.wpp_server & online.fixPos to support wppdb sharing between online wifi/cell location & google location db persistance.
3) Support both central rotate file logging & linux syslog for multi-process environment.
2011-08-04
1) Refactor wpp to add fingerprint (from part of offline) & location (from online, online is dropped) & util.net (from net related tools from offline, util.geolocation_api).
2) Add util.stats_srcline to stats source code lines of python & bash files.
2011-08-14
1) Add util.up_areanames for updating areanames(en,cn) in |wpp_cellarea| for areaLocation.
2) Mod location.fixPos() to return chinese area name when needed.
3) Minor mod db.WppDB.execute().
2011-08-21
1) Add nose test framework.
2) Mod wpplog definition to wpp.config module.
3) Use logging instead of print in wpp.location.fixPosWLAN()
2011-09-07
1) Fix 'Time' attrib val interpretation in PosReq xmlnodes for location.fixPos()
2) Mod Error limit up to 8000 in util.geolocation_api.googleLocation
2011-12-09
1) Fix to add area_try by 1 whenever the google area location was ok or not in offline module.
2) Fix WLAN FP location for new office building.
2011-12-11
1) Fix area name/code query err in db.addAreaLocation() when district name has 2 chars and chinese word qu in the end
2) Mod default port to be 8080 in wpp.web.wpp_server __main__ section
2012-02-06
1) Fix doClusterIncr() with null-wifi FPs.
2) Add colorized logwatch for log tailf.
2012-02-12
1) Add logwatch support for indoor FP collection routine.
2) Mod wlan print format to be more tabular.
2012-02-14
1) Add indoor FP collection routine.
2012-02-19
1) Fix incr-clustering error introduced by whitespace in MACS, RSSs, and time fields.
2012-02-25
1) Fix *macs* value err when FP has duplicate MACs in fingerprint.search_cluster().
2) Fix outdoor FP field(time, rsss) index error in fingerprint.doClusterIncr().
3) Add algo debug switch in config.