forked from arkime/arkime
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathCHANGELOG
1720 lines (1618 loc) · 81.5 KB
/
CHANGELOG
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
NOTICE: Please see https://arkime.com/faq#upgrading-moloch for upgrading info
ES Versions:
* Moloch >= 3.0.0 supports ES >= 7.10.0
* Moloch >= 2.7.0 supports ES >= 7.4.0
* Moloch >= 2.2.0 supports ES >= 6.8.0 or >= 7.1.0
* Moloch >= 2.0.0 supports ES >= 6.7.0 or >= 7.1.0
* Moloch >= 1.5.0 supports ES >= 5.5.0, 6.x, not 7.x or later
* Moloch >= 1.0.0 supports ES >= 5.5.0, 6.x (not prod tested, only for new installs), not 7.x or later
* Moloch >= 0.50.0 supports ES >= 5.5.0, not 6.x or later
* Moloch >= 0.18.1 supports ES 2.4.x, >= 5.3.1 not 6.x or later
Node Versions:
* Moloch >= 3.0.0 requires NodeJS 14.x
* Moloch >= 2.4.0 requires NodeJS 12.x
* Moloch >= 2.0.0 requires NodeJS 10.x
* Moloch >= 1.6.0 requires NodeJS 8.x, 8.12 or later
* Moloch >= 1.0.0 requires NodeJS 8.x
* Moloch >= 0.20.0 requires NodeJS 6.x
* Moloch >= 0.18.1 requires NodeJS 4.x
NOTICE: Restart wiseService before capture when upgrading
NOTICE: Cross-cluster Shortcuts require you to not restart all your viewers at once after upgrading
3.0.0 2021/07/xx
- BREAKING - elasticsearch - ES 7.10.0 or later required
- BREAKING - if not using a ES prefix, the prefix arkime_ will now be used
- BREAKING - multies - multiESNodes requires a name: and prefix: attribute per entry
- BREAKING - wise - custom sources will need to be modified
- BREAKING - wise - redis urls have a new standard format
- BREAKING - wise - for json data keyColumn has been renamed keyPath
- BREAKING - wise - now lower case lotermfield and upper case uptermfield fields
- BREAKING - capture - override-ips will no longer have leading 0s for ASN
- release - curl 7.78.0, node 14.17.4, glib 2.66.4, yara 4.0.2, lua 5.3.6, maxmind 1.4.3
- capture - search for GeoIP files first in /var/lib/GeoIP
- capture - fixed possible ABR with time parsing
- capture - fixed memory leak with dns bad hostname parsing
- capture - new classifier for nfs and several rpc protocols
- capture - handle larger oracle connect msgs better
- capture - parse small http basic auth headers correctly
- capture - rule matches can now be logged
- capture - new localPcapIndex setting to enable pcap index on capture node instead of ES
- capture - write long open tcp sessions every tcpSaveTimeout even if no syn
- capture - fixed possible memory corruption with --flush option
- capture - check max packet length in more places
- capture - parse proxy-authorization header (PR #1651)
- db.pl - new urlinfile://filepath where elasticsearch url is the first line of filepath file
- db.pl - fix history mapping issue
- viewer - add POST version session query APIs to support long expressions
old GET versions still work
- viewer - reorganize and standardize APIs
- viewer - put npm scripts and common npm packages at top level
- viewer - allow viewing of large encrypted pcap files (issue #1555)
- viewer - can find nodes for pcap based on --host
- viewer - in multiviewer mode can now select which clusters to search (PR #1325)
- viewer - fix addTag/removeTag with multiviewer (PR #1556)
- viewer - can modify some sessions2 template from esadmin tab
- viewer - can modify entire shortcuts now
- viewer - spigraph visualization improvements
- viewer - Can set watermark settings again
- viewer - Start moloch -> arkime cookie changes
- viewer - dark theme improvements
- viewer - can now toggle on/off capture start times
- viewer - improve toolbar for packet display
- viewer - standardize on . ipv6 and : ipv4 por separator
- viewer - send shallower queries to ES when possible
- viewer - fix cron queries when using autoGenerateId
- viewer - improve session settings across sessions
- viewer - fix multiple requests when changing views and start/stop times
- viewer - fix setting user permissions not applying until page reload
- viewer - improve column resizing
- viewer - add button to open sessions cron query tagged
- viewer - notifier links to results
- viewer - cancel hunts & remove hunt name and id from sessions
- viewer - shortcuts sync across all clusters if usersElasticsearch and cronQueries is set
- wise - new config UI, enable with --webconfig
- wise - more moloch->arkime changes
- wise - for json data can now set arrayPath for start of where to parse
- wise - new elasticsearchfile type
- wise - threatstream results now cached
- wise - support memcached for cache
- wise - new urlinfile://filepath where config is the first line of filepath file
- wise - help page
- wise - valueactions can be stored in flat file, redis or elasticsearch
- all - renamed rightclicks to valueactions
- all - many typos fixed
- all - support Elasticsearch API Keys (elasticsearchAPIKey setting)
- esproxy - first version, see https://arkime.com/esproxy
2.7.1 2020/12/01
- release - glib 2.66.2, curl 7.73.0, nghttp2 1.42.0
- wise - fix UI queries hanging
- viewer - fix anonymous user settings not saving
- viewer - fix lastUsed time not always saving to ES
- capture - new packet dedup feature https://arkime.com/settings#packet-deduplication-settings
- capture - close pfring on exit (issue #1538)
- capture - fix http2 parsing crash
- db - Moloch to Arkime text fixes
2.7.0 2020/11/18
- NOTICE - Requires ES 7.4 or newer
- NOTICE - Moloch to Arkime rebranding in UI, everything else still Moloch
- all - ES 7 updates, fix most depreciated warnings (mappings/templates still remain)
- viewer - fix mpls decoding
- viewer - new themes and logo selection
- capture - fix http CONNECT response parsing
- capture - New pcap-over-ip reader support
- db - can import gz files directly now
- db - fix issues with version importing
2.4.2 2020/11/10
- NOTICE - db.pl upgrade is required
- NOTICE - this is the last version to support ES 6
- release - node 12.19.0
- viewer - support utf8 chars in content-disposition
- viewer - add capture process restart to timeline graphs
- viewer - add "bookmarks"
apply a view's expression to the search input without issuing a query
- viewer - fix anonymous users settings not being saved
- viewer - share hunts between users
- viewer - move all common client bundling, scripts, and npm modules to top level
- viewer - display business hours on sessions timeline graph
- viewer - fix multi mpls header decoding
- viewer - fix viewer crashing when pcap file not available
- viewer - new getSessionBySearch setting
- viewer - decode vxlan packets better
- viewer - add help icon
- viewer - added startTime and runningTime capture stats
- capture - QUIC version 5x detection
- capture - smtp decoding handles clients that break utf8 section incorrectly
- capture - fix a json parsing fail would cause next json parse to fail even if good
- capture - support 0x6558 Ether Bridging
- wise - threatstream improvements when using the sqlite db
- db - fix rm-node to delete over 10k items, and bad count display
- tests - use our oui/rir files
2.4.1 2020/09/28
- NOTICE - db.pl upgrade is required
- NOTICE - the elasticsearch and usersElasticsearch variables must start with http:// or https://
- release - node 12.18.4
- viewer - fixed export pcap from actions menu not working
- viewer - capture stats/graph now uses regex instead of wildcard
- viewer - support -reindex indices
- viewer - log more info when can't open a file
- viewer - lastpass boxes removed
- viewer - can now edit ILM values from ES Admin tab if ./db.pl ilm has been used previously
- viewer - handle hunts with bad regex better
- viewer - change capture stats default length to 200
- viewer - fix password change with aes256Encryption turned on
- viewer - handle hunts when nodes are down better
- wise - UI improvements
- wise - theatstream mode sqlite3 no longer copies the db, use sqlite3-copy for old behaviour
- parliament - show bits instead of bytes
- db - new reindex command
- capture - http2 header fields were not always indexed correctly
- capture - fix g_hash_table_contains warning
- capture - rules can use special ip values ipv4 and ipv6 now
- moloch_update_geo.sh - fix possible security issue
2.4.0 2020/08/25
- NOTE - RHEL/Centos 6 is no longer supported, Node 12 required
- NOTE - New encoding of packetPos, set gapPacketPos=false for old encoding
- NOTE - 2.4.x will be the last versions to support ES 6
- release - node 12.18.2, glib 2.64.5, curl 7.72.0
- release - Ubuntu 20 support
- viewer - aes256Encryption now defaults to true
- viewer - added a clear cache button to ES Admin tab
- viewer - quote expressions with [ or ] in them
- viewer - add button to only show data nodes on ES Nodes tab
- viewer - files tab can now show the packet pos encoding
- viewer - ES Indices tab can now show the avg doc size per index
- viewer - ES Nodes tab can now show shards and segments per node
- capture - http2 decoding for PRI * h2 sessions
- capture - set http2 protocol when alpn is h2
- capture - upgrade h2c http2 decoding
- capture - no longer use internal libpcap function
- capture - simple writer supports maxFileTimeM (PR #1506)
- capture - new packetPos encoding saves 10%-20% overall ES space
- capture - remove old disk writer methods, use simple or simple-nodirect now
- wise - simple UI
- wise - support json file format config files
2.3.2 2020/06/29
- NOTE - 2.3.x will be the last version to support RHEL/Centos 6
- release - node 10.21.0
- capture - minor tcp dns parsing performance improvement
- capture - refactor some code to be more type safe
- capture - deal with bad utf8/puny in dns and altnames
- viewer - warn at starting about missing ./vueapp/dist/index.html
- viewer - can now use db:<dbFieldName> in expressions (PR #1463)
- viewer - if esAdminUsers isn't set, ES Admin tab now shows up for admins
- viewer - ES Nodes can display molochzone attribute now
- viewer - fixed some Users tab issues
- viewer - fix percentage sorting on ES Recovery tab
- viewer - "right click" actions can how show text in menu with fetch actionType
- viewer - "Reverse DNS" menu option on ips
2.3.1 2020/05/27
- all - Lots of changes to support node 12 in the future (thanks rnbwdsh)
- viewer - fix bug where the next query after an empty query might hang the UI
- viewer - use the same eslint as the UI & parliament, lots of lines changed
- viewer - can now modify or delete a view from the popup
- viewer - fixed so non admins can cancel their searches again
- viewer - fixed columns not always loading with views
- viewer - when user creates a view it will auto switch
- viewer - does basic ip validation in queries
- viewer - fixed users tab header being hidden
- capture - fixed out of bounds read in smtp parsing
- capture - Lowered the default number of ES retries to 2, added new
esMaxRetries setting
- wise - upgraded sqlite version and changed from hashtable to Map (thanks rnbwdsh)
- db.pl - The info command will now display estimate for how many days can be stored
2.3.0 2020/05/06
- release - CyberChef 9.16.2, node 10.20.1, daq 2.0.7
- viewer - set content-type for cyberchef files
- viewer - add support for caTrustFile to addUser and multies
- viewer - can now select to show any integer field in graphs, set on the settings page
- viewer - graph/header can now be pinned to not scroll off page
- viewer - most navbars can be collapsed and hidden
- viewer - mouse over in graphs now show total values too
- viewer - fixed left/right keys not working in search bar after visiting stats page
- viewer - support cancel for multies
- viewer - cleaned up some of the Help docs
- capture - new parsers arp, bgp, igmp, isis, lldp, ospf, pim,
- capture - protocol parsing code has been refactored, can now write parsers
of ethernet and other ip protocols
- capture - new disableParsers, default of arp.so
- capture - new unkEthernet, unkIpProtocol protocols
- capture - support QUIC version 46
- capture - new esBulkQuery setting to override the /bulk call
- capture - added some more lua examples (thanks Antipokemon)
- wise - threatstream fixes to be nicer to the sql database
- all - switch most ES apis to typeless format
2.2.3 2020/03/09
- viewer - Experimental treemap view in spigraph
- viewer - Hunts now retry talking to failed remote nodes
- viewer - Completed Hunts have a repeat button
- viewer - Fix some Hunt stat and display issues
- viewer - Fixed Hunts/Tags working with ILM
- viewer - Fixed notifier issues and issue #1365
- viewer - Increase navbar contrast
- viewer - Spiview should be faster loading data
- viewer - Debug now prints out config vars like capture
- release - Fix lua.so not being included with builds
- capture - Fix "-r -" not working
- parliament - Ignored issues should remain unless deleted
- db - Can set sessions refresh interval
2.2.2 2020/02/18
- release - node 10.19.0
- capture - fix SYN retrans handling
- capture - New tcphealthcheck plugin (thanks fj604)
- capture - support communityId field in rules/wise
- capture - fixed drop stats for long running systems
- viewer - Fix decode crash (thanks mammo0)
- viewer - experimental pie chart in spigraph
- viewer - experimental table view in spigraph
- viewer - fix viewer crash when hunting fake sessions (issue #1374)
- viewer - fix capture stats sort
- viewer - new accessLogFormat, accessLogSuppressPaths settings to
better control logging (issue #1375)
- viewer - do a better job decoding http 100 continue msgs
- decryptPcap.js - can now decrypt Moloch encrypted pcap files to stdout
- s3 - Fixes the problem where the s3 token expires during a capture (issue #1370)
- s3 - more logging on errors
- s3 - new s3Host setting (thank jc2k)
- all - debug can be set in config file, used if no command line debug args
2.2.1 2020/01/21
- capture - fix --skip not working with ES 7.x
- capture - update TLS ciphers
- capture - increase offlineDispatchAfter default to 2500
- capture - cert decode publicAlgorithm and curve
- db - optimize-admin doesn't wait for other optimizations to finish
- lua - save/pre_save callbacks, can now get most fields
- viewer - fix viewer notifiers (issue #1361)
2.2.0 2020/01/13
- NOTE - Elasticsearch 6.7.x is no longer supported
- NOTE - MaxMind now requires an account, set up your geoipupdate script
https://molo.ch/faq#maxmind
- release - node 10.18.1, yara 3.11.0, curl 7.68.0
- release - Configure now installs elasticsearch 7.5.1
- viewer - New aes256Encryption option to upgrade encryption, all
viewers must be on 2.2.0 or later before upgrading
- viewer - shrink operation deletes old index now
- viewer - Querying was sometimes limited to 20000 items (or less)
- viewer - Sending sessions between clusters didn't allow pcap to be viewed
on receiving side
- viewer - Intersection export allows editing of fields
- viewer - Panning graph left/right allows selection of how much
- viewer - Refresh interval on spigraph page increments time (if it's a date range)
- capture - geoLite2ASN and geoLite2Country are now semicolon separated
lists. The first one that exists will be used or warning
printed. To disable warning set to blank.
- capture - disable the 100-Continue feature of curl to reduce bulk errors
- capture - smtp parse now maps a few encodings to standards glib understands
- s3 - support maxFileTimeM
- db - support creating ILM policies and assigning them for sessions2 and history
- db - new optimize-admin that only optimizes admin indices
- parliament - Click on ES health goes to ES Nodes tab
2.1.2 2019/12/16
- capture - no longer check in configure scripts, use autoreconf (thanks martinpaljak)
- capture - new http header raw callback for plugins (thanks pjsg)
- lua - Improvements and new sample script (thanks pjsg)
- viewer - more cyberchef fixes
- viewer - increased timeout on indexing
- viewer - show menu/protocol column on sessions page even if there are no
visible columns (issue #1337)
- parliament - make sure good config before writing (issue #1181)
2.1.1 2019/12/09
- release - cyberchef 9.11.7
- wise - fix view duplication when reload tagger file (#1315)
- capture - string fields created with wise/custom-fields are now assumed utf8
- capture - term signal handled better
- s3 - handle longer tokens and path vs host access
- viewer - support -o option to override config file like capture has
- viewer - new "ES Admin" tab, enable with esAdminUsers= in config.ini
- viewer - Hopefully fix cyberchef integration on all browsers
- viewer - better shrink index support for viewing pcap
- viewer - anonymous should work better for more features
- viewer - work around ES slow _count API in 7.x
- viewer - hunts support views better
- db - new warmkind option for specifying what units the warm number is in
- db - fix versionNumber printing
2.1.0 2019/11/19
- NOTE: All viewers must be 2.1 or later for them to communicate. If not
upgrading at once set s2sSignedAuth=false in default section of config.ini
- release - node 10.16.3, curl 7.66.0, glib 2.59.0, libpcap 1.9.1
- release - remove ubuntu 14 builds
- release - initial centos8 build
- db - new shrink command
- db - new --gz option to compress backups
- capture - support named pipes better (issue #1169)
- capture - New email.smtpHello field
- capture - fields created with wise/custom-fields are now set across
linked sessions by default now
- capture - deal with extra long config values in more places
- capture - snf improvements
- viewer - default max aggregation size is 10000 to work with ES 7.x OOTB,
new maxAggSize setting
- viewer - added right-click replacer for %DBFIELD% (thanks tlacuache)
- viewer - display JA3s and hassh
- viewer - support file expression in more places (issue #1172)
- viewer - fix files date display (issue #1164)
- viewer - csp header support
- viewer - Fix some XSS/rXSS by setting correct content type
- viewer - Improve permission checking
- viewer - Use RE2 for regex
- viewer - shortcuts can be locked from changes
- wise - switch to ioredis implementation so clusters/sentinel works
- s3 - many fixes (thanks pjsg)
- s3 - support compressing pcap when s3WriteGzip is set to true (thanks pjsg)
- s3 - can fetch data from metadata service (thanks pjsg)
2.0.1 2019/09/09
- release - cyberchef 9.4.0
- capture - label TLS 1.3 sessions correctly (issue #1137)
- capture - New simpleMaxQ setting to control max disk Q
- capture - http CONNECT method will now classify payload (issue #1153)
- capture - Initial dtls support
- viewer - cancel current ES query on new query
- viewer - fix connections page timezone
- viewer - fix not auto quoting all expressions (issue #1146)
- viewer - fix security warnings
2.0.0 2019/08/19
- NOTICE: This versions requires ES 6.7.x (6.8.2+/7.3+ recommended) or later
- NOTICE: db.pl upgrade is required, see https://molo.ch/faq#how_do_i_upgrade_to_moloch_2
- release - cyberchef 8.30.0, node 10.16.2, yara 3.10.0
- release - include sample headers parsing and turn them on by default
- release - easybutton supports osx
- all - Fix some elasticsearch deprecation warnings
- all - elasticsearch 7 support
- db - backup command now saves meta data so restore can do a rollback (thanks codesniffer)
- db - improve optimize to deal with connection closed better
- parliament - Can configure multiple of each type of notifier
- viewer - Can display pcap retention in Capture Stats tab
- viewer - Added uploadFileSizeLimit
- viewer - Can interact with users in multiES if usersElasticsearch is set
- viewer - Can just delete SPI
- viewer - Added shortcuts feature
- viewer - add bytes as a graphing choice
- viewer - support ip == ipv4 and ip == ipv6 expressions
- viewer - pivot dropdown option in spiview (issue #1135)
- viewer - optional millisecond display
- viewer - Support view parameter for unique/multiunique
- viewer - Support ES client auth and insecure better (thanks Scott)
- viewer - Lots of stats summing, avg, sorting fixes
- capture - Initial ipv6 gtp support
- capture - no longer send packet lengths to ES by default (enablePacketLen)
- capture - add truncated-pcap tag to sessions where all pcap isn't written
- capture - fixed ja3s mishandling of 10/11 extension types (thanks Norwegian Healthcare CERT)
- capture - fixed ja3 mishandling of 11 extension types (thanks Norwegian Healthcare CERT)
- capture - Added startsWith,contains,endsWith rule expression modifier
- capture - honor the caTrustFile directive (thanks Matt)
- capture - fix data bytes calculations for icmp/udp (thanks Brian)
- capture - initial vxlan support
- capture - Myricom/AFPacket improvements (thanks Scott)
- capture - updates to classifiers: telnet, mpls
- suricata - support timezones and slashes in signatures better
- suricata - support huge alert lines
- wise - support arrays for json elements
1.8.0 2019/04/03
- NOTICE: This will be the last version to support ES 5
- NOTICE: db.pl upgrade is required
- all - support tokens for host.*/http.uri/http.useragent field
- viewer - should output csv with commas in fields correctly
- viewer - new Show Packets view in session detail
- viewer - map show xff countries
- capture - libfuzzer fixes
- capture - fix core on exit if a pcapDir doesn't exist (issue #1030)
- viewer - new elasticsearchTimeout var that is used with ES queries
- viewer - can now limit query time frame per user
- viewer - node stats now paginates correctly
- viewer - support hsts (issue #853)
- viewer - support simple range queries field == min-max (no spaces)
- viewer - Users page refactor
1.7.1 2019/02/14
- NOTICE: db.pl upgrade is required
- viewer - upgrade to d3 v5 for connections page
- viewer - typeahead history for spigraph/connections
- viewer - stats tasks page has a num item selector now
- viewer - welcome message for new users
- viewer - save the last time a user used moloch
- viewer - two --debug will display why proxying traffic
- viewer - connections now uses ipv6.port and ipv4:port
- viewer - fix date/time picker timezone and input bugs
- wise - support json paths
- wise - improve alienvault loading
- capture - more tcpflags fields can be matched with rules
- capture - print more stats at exit with --debug
- capture - fix small bpf memory leak
- capture - rules can support most .cnt fields
- capture - fix OBR if cert has no serial
- capture - libfuzzer support and initial fixes
- parliament - add no alert cluster type
- parliament - remove selected acknowledged issues
- parliament - add help page
1.7.0 2019/01/17
- NOTICE: db.pl upgrade is required
- release - node 8.15.0, cyberchef
- capture - new cert remainingDays field
- capture - new tcp initRTT field
- viewer - cron query notifications (issue #489)
- viewer - can't use es scroll api with "from" (issue #981)
- viewer - Export CSV uses the columns shown
- viewer - field history for search expression (issue #595)
- viewer - fix date/time picker not using user set timezone (issue #977)
- viewer - don’t display undefined or empty field values
- viewer - fix timezone parsing in session detail date field values
- viewer - show error if using an outdated browser (issue #980)
- viewer - export results intersection
- viewer - add clickable labels to the info column
- viewer - reset the width of the session table columns when switching back to the default
- parliament - search and page results on the issues page (issues #982 and #983)
- parliament - add a length of time threshold for “low packets” issues (issue #968)
- capture - Fixed corrupt file sequence numbers being used when
when ES is under heavy load
- capture - Fix importing more then 256 files at once not working correctly (issue #984)
- all - communityId support for tcp/udp (issue #966)
- capture - In live capture clean up sessions even if no packets are being received
- db - improve expire efficiency
- capture - fix elasticsearch classifier
- capture - for offline pcap honor umask when --copy is used (issue #976)
- viewer - Fix some rXSS, thanks Esben Sparre Andreasen of Semmle Security Research Team
1.6.2 2018/12/07
- NOTICE: db.pl upgrade is required
- suricata - fix crash when signature name > 128 characters long
- suricata - fix severity parsing (again)
- capture - fix possible crash when exporting invalid utf8
- db - support new --shardsPerNode option
- viewer - don't issue search when closing the date/time pickers
- viewer - download packets src/dst bytes img
- viewer - option to show timezone with every timestamp
- viewer - added new user permissions (hideStats, hideFiles, hidePcap, and disablePcapDownload)
- parliament - add option to provide link to dashboard in alert notifications
- viewer - configure connection node/link popup data
- release - build snf plugin with screwdriver
- capture - fix tls parser infinite loop
- viewer - can customize fields in the info column
- viewer - new es recovery tab
- viewer - stats page shows when data is being loaded from server
1.6.1 2018/11/06
- NOTICE: db.pl upgrade is required
- capture - ja3s support (issue #949)
- capture - hassh support (issue #950)
- capture - simpleKEKId can be a template
- all - Certificate org names can be an array now
- wise - reverse dns supports servers setting
- all - new written/unwritten stats to see how much Moloch has written or
not written to disk
- all - don't index packet positions or packet lengths in ES
1.6.0 2018/10/29
- NOTICE: db.pl upgrade is required
- release - glib 2.56.2, yara 3.8.1, curl 7.61.1, lua 3.3.5, node 8.12.0
- db - expire checks min lastPacket in each session2 like curator, not just
based on name
- wise - support any field for ES WISE source
- viewer - packet search (hunt)
- viewer - admins can see forced expression for users in history
- viewer - option to add sessions table column configuration to a view
- viewer - files and stats tables can be customized
- suricata - parse severity
- capture - new _dontCheckYara rule ops
- parliament - add --debug option
- parliament - add --dasboardOnly flag
- capture - set vlan field for afpacket
- capture - new setting parseHTTPRequestHeaderAll, which will parse ALL request
headers not already parsed into 1 ES field (pr #914)
- capture - new setting parseHTTPResponseHeaderAll, which will parse ALL response
headers not already parsed into 1 ES field (pr #914)
- capture - new setting parseSMTPHeaderAll, which will parse ALL email headers
not already parsed into 1 ES field (pr #914)
- capture - new setting parseDNSRecordAll, which will parse a full DNS record
into multiple new ES fields (pr #914)
- viewer - show shortcuts on shift
- capture - initial gtp tunnel support (issue #926)
- wise - new wiseLogEvery to control how often plugin logs (0 disables)
- capture - experimental autoGenerateId config to use ES auto generated ids
- viewer - Ability to download files based on hash (pr #927)
- viewer - Can resize/save columns (issue #909)
- multiviewer - Can save user settings and such (pr #935)
- viewer - Can share views with all other users
- db.pl - New backup/restore commands, saves everything but sessions
1.5.3 2018/09/10
- release - libpcap 1.9.0
- all - new hourly[2348]/hourly12 rotateIndex
- all - deal with talking to multiple wise servers better
- all - --insecure option
- all - use package-lock.json so all builds use the same packages
- viewer - fix some spiview display issues (dns ip, email headers)
- viewer - fix upload command tags (issue #888)
- viewer - aes-256-ctr: fix issues decoding larger files
- viewer - set rejectUnauthorized for ES connections (issue #894)
- viewer - fix some payloads not displaying for css reasons
- viewer - added zoom buttons to connections
- viewer - keyboard shortcuts
- capture - require gnu99 supporting compiler
- capture - if single tcp data packet left at save time, try and classify it (issue #880)
- capture - for live captures prevent out of order stats records
- capture - aes-256-ctr: iv is 12B, limit maxFileSizeG to 64G, dek is more random
- capture - Added corrupt setting to saveUnknownPackets
- capture - new -o option to override config file from command line
- capture - trim leading/trailing whitespace from config options
- capture - new --nostats option to stop stats from being sent to ES
- capture - fix http socket leak on errors
- capture - new -F option to specify files that contain a list of pcap files to process
- capture - new --reprocess option that won't create a new file entry (but
will duplicate SPI data)
- capture - add IPPORT_DROPPED count to stats log
- capture - fix some possible bad memory reads in oracle/radius/http parsers
- capture - fix some possible integer overflow issues
- capture - fix tcp sequence number issues
- parliament - uses Vue now
- parliament - support email alerts
- parliament - new edit slider to show edit buttons
- parliament - many improvements how issues work
1.5.2 2018/07/26
- capture - new custom-fields section
- viewer - new custom-views section
- capture - fix for inplace pcap ingestion not displaying pcap in viewer, introduced in 1.5.0
- capture - support QUIC version >= 40
- release - Build Ubuntu 18.04 version
- wise - fixed sources that didn't register at startup
1.5.1 2018/07/23
- capture - fix ipv6 sctp hang
- viewer - added back many tooltips
- viewer - fix crash when node doesn't exist
- viewer - fixed some fields not showing up
- snf - new config snfFlags
- viewer - fix sorting by a column that isn't in all indices
- capture - memory leak fix
- suricata - keep alerts for suricataExpireMinutes setting
1.5.0 2018/07/16
- BREAKING: wiseCache redis name changes
- viewer - sessions, spiview, spigraph, connections, help, users, history pages implemented
in Vue instead of AngularJS
- viewer - split stats capture graphs/stats into 2 tabs
- viewer - stats now has sort option
- capture - new maxTcpOutOfOrderPackets setting, default 256
- capture - drophash supports v6 and saving
- wise - support talking to wise over https, use wiseURL
- capture - basic mqtt parsing
- capture - rules reload without restarting
- viewer/db - new hide-node/unhide-node commands to hide commands in capture stats
- viewer - New queryAllIndices
- multiviewer - no longer need to have the same rotateIndex everywhere
- capture - initial saveUnknownPackets support
- capture - new interfaceOps for ops per interface
- capture - new filenameOps for ops per filename (issue #857)
- s3 - use 1.0 field names
- viewer - fix a case when decoding failed
- all - ESP now has first packet capture if trackESP is set
- capture - magicMode remove molochmagic and added both mode
- wise - initial splunk source
- capture - new suricata plugin
- wise - [right-click] with no colon now loads directly from wise.ini
- capture - decode dns punycode into dns.host, dns.puny has original
- capture - yaraEveryPacket (default true) when false only does first packets
- capture - yaraFastMode (default true) when false turns off fast mode
- viewer - switch to javascript png implementation
- all - added some GRE erspan support
- viewer - support gt/lt queries for ip
- capture/wise - can now configure what fields map to what wise queries and
send almost any field (issue #840)
- all - added used space stat
- all - changed free space stat to use 1000 based units
- viewer - removed AngularJS, all pages implemented in Vue
- capture - hsrp classify
1.1.1 2018/05/31
- all - fix http.statuscode
- capture - fix _dropByDst/_dropBySrc crash
- capture - tcpflag are always counted (issue #849)
- viewer - fix 10k sessions.json failure
1.1.0 2018/04/30
- all - basic sctp capturing, no decoding (issue #828)
- all - initial unencrypted 802.11 Data Frame support (issue #834)
- db - new segments option to expire and optimize
- release - curl, node, cyberchef
- viewer - http.uri and host* allows pasting a URL and doing the right thing (pull #831)
- capture - New logHTTPConnections setting (pull #749)
- capture - new wiseExcludeDomains setting, used before sending to wiseService (issue #340)
defaults to ".in-addr.arpa;.ip6.arpa"
- wise - full ipv6 support
- capture - basic sccp classify
- all - initial frame relay support (issue #838)
- all - initial 4 over 6 and 6 over 4 support
- viewer - support fields=id for sessions.csv (issue #839)
- reindex2 - added --pause option
- viewer - more stats page fixes
1.0.0 2018/04/05
- db - always update stats/dstats indices for now
- parliament - fix es drop error msg
- tests - make server everything has started before running tests
1.0.0-rc2 2018/03/29
- viewer - Change default spiDataMaxIndices to 4 everywhere
- viewer - work around for ES 6 issue https://github.com/elastic/elasticsearch/issues/27740
- capture - fixed netflow plugin
- tests - initial parliament tests
1.0.0-rc1 2018/03/20
- viewer - minor stats page fixes
- release - new top level package.json/node_modules to make package smaller
1.0.0-beta3 2018/03/15
- viewer - stats page implemented in Vue instead of Angular
- capture - some code clean and better thread safe counters
- viewer - convert field names in saved column sets from pre 1.0
1.0.0-beta2 2018/03/08
- capture - decode some dhcp
- capture - tag a tls session with cert:self-signed
- capture - reload geo, rir, yara and oui files without restarting (issue #692)
- capture - remove yara 1.x support
- viewer - cron jobs now use the timestamp time and not last packet time when choosing sessions to look at
this means delay is shorter, although when upgrading to 1.0 some sessions will be not looked at.
1.0.0-beta1 2018/02/20
- capture - calculate sha256 too (set supportSha256 tru)
- wise - support sha256 lookups
- capture - fix disable fields
- capture - src/dst ip/port can be used to trigger rules now
- capture - ip fields in rules can now be CIDR
- capture - simple writer now flushes after 10 seconds of no writing
there still can be pagesize bytes unwritten (issue #777)
1.0.0-alpha2 2018/01/31
- Read alpha1 below
- release - correct geo files
- capture - set default geo file path
1.0.0-alpha1 2018/01/26
- NOTICE: Supported ES Versions: 5.6.x, 6.x (for new installs)
- NOTICE: hasheader for email/http for old sessions will not be migrated
- all - rename all field names
- all - no more analyzed ES fields, everything is a keyword field
- all - full ipv6 support
- all - tags index removed, tags/hasheader stored as first class fields
- all - new reindex2 script to move from pre 1.0 to 1.0
- capture - http uri field no longer starts with // (issue #732)
- capture - use maxminddb instead of geoip now (issue #771)
- all - Country codes are now 2 letters instead of 3 letters
- release - node 8.9.4
0.50.1 2018/03/29
- NOTICE: Supported ES Versions: >= 5.5.0, 6.x is NOT supported
- release - upgrade curl, yara, glib
- viewer - sessions.csv handle multiple fields parameters
- parliament - better dismissing
- all - new hourly6 rotateIndex, for every 6 hours
- parliament - first version of alerts
- parliament - rename server.js to parliament.js
- wise - trim spaces after splitting config values
- capture - better pop3 detection
- capture - correctly lowercase user
- release - added --install to easybutton (issue #812)
- capture - basic memcache classify
- viewer - disable TLS 1.0
- viewer - ES scrolling should be much faster
0.50.0 2018/01/24
- NOTICE: Supported ES Versions: >= 5.5.0, 6.x is NOT supported
- viewer - Fixed CSV export of fields within objects (issue #790)
- capture - Retry http requests on connect failures
- capture - better SLL pcap support (issue #791)
- capture - icmp code and type were swapped
- viewer - shards tab can now exclude/include nodes/ips to move shards around
- capture - removed ES check for http.compression since on default in ES 5
- capture - clean up sockets better
- db.pl - now default to a max of 24 shards
- parliament - initial display of detected issues
- parliament - move all calls behind /parliament to make easier to reverse proxy
- viewer - users forceExpression handles special characters correctly again
0.20.2 2018/01/04
- NOTICE: Supported ES Versions: 2.4.x, > 5.3.1, 6.x is NOT supported
- viewer - upgrade elasticsearch-js
- capture - new --host commandline option to specify how viewers should talk to host
- capture - added classify: dhcp, dhcpv6, splunk, isakmp, aruba-papi
- capture - improved classify: bitcoin, ntp, ssdp
- capture - index first N (default 256) bytes of post bodies, controlled by maxReqBody setting
- capture - more stats on packet processing/failures
- viewer - cleanup sessionErro
- viewer - remove dead code
- tests - more viewer tests
- viewer - upgrade Cyberchef to 6.8.0
- capture - basic mpls stripping (issue #779)
- viewer - start of esshards tab in stats
- parliament - first version (can install with Configure --parliament)
- wise - can now install with Configure --wise
- release - node 6.12.3
0.20.1 2017/11/06
- NOTICE: Supported ES Versions: 2.4.x, 5.1.2, 5.2.x, > 5.3.1, 5.4.x, 5.5.x, 5.6.x
- viewer - graph hover now respects timezone setting (issue #757)
- capture - decode icmp type/code (issue #751)
- viewer - upgrade Cyberchef to 6.4.5
- viewer - es indices tab (#761)
- viewer - es tasks tab (#763)
- capture - ssh parser crash fixed (introduced in 0.20.0)
0.20.0 2017/10/31
- NOTICE: Supported ES Versions: 2.4.x, 5.1.2, 5.2.x, > 5.3.1, 5.4.x, 5.5.x, 5.6.x
- NOTICE: db.pl upgrade is required
- capture - added --packetcnt from @jmd1212
- capture - handle monitor directory being empty
- capture - basic fbzero parser as quic
- capture - pjl, dcerpc detection
- release - on ubuntu, plugins weren't loading dependencies correctly
- viewer - made number of packets displayed setting accurate
- release - move node install from release to easybutton (issue #720)
- release - install ES 5
- capture - initial SMTP BDAT support
- viewer - initial history support
- capture - new advanced setting maxMemPercentage that will abort capture if reached
- capture - basic rip, nzsql detection
- capture - improved quic, mysql detection
- capture - plugins can now replace how SPI data is sent to ES
- viewer - fixed right client menu not working (issue #740)
- viewer - add/remove tags update tag count (PR #756)
- viewer - support sessions resize better
- release - use screwdriver to build and test
- release - upgrade node version
- viewer - fix EXISTS! being reformatted (issue #747)
- viewer - Don't allow * by itself in expressions anymore, must use EXISTS!
- viewer - removed babel, newer browsers required
0.19.2 2017/08/25
- NOTICE: Supported ES Versions: 2.4.x, 5.1.2, 5.2.x, > 5.3.1, 5.4.x, 5.5.x, 5.6.x
- NOTICE: Requires wiseService upgrade if using wise
- capture - ja3 support (https://github.com/salesforce/ja3/) (issue #706)
- viewer - spi view column sets (issue #713)
- viewer - remove jade dependency since using pug now
- release - node 6.x
- viewer - fix world map button (issue #724)
- tests - viewer tests are updated and all passing again
- viewer - most session detail labels now have menus (issue #723)
- s3 - fixed deadlock (issue #716)
- wise - only allow 4096 waiting sessions
- viewer - add top 10 countries to map (#564)
- viewer - type ahead improvements, disable by default for multiviewer
- snf - fix build (issue #719)
- viewer - abbreviate large units for data bytes (issue #680)
- viewer - add href to nav tab links (issue #651)
- viewer - save spiview fields (issue #715)
- easybutton - Upgrade yara, glib, curl versions
- viewer - session columns are resizable (issue #676)
- wise - ja3 support
- capture - fixed capture crash when wiseService is restarted
- release - build a better NOTICE file for binary releases
- wise - don't crash on "null" json values
- viewer - decode Basic auth values
- viewer - ES scrolling should work better
0.19.1 2017/07/13
- NOTICE: Supported ES Versions: 2.4.x, 5.1.2, 5.2.x, > 5.3.1, 5.4.x
- viewer - stats bytes human readable format
- capture - fix wise plugin crash
- viewer - handle corrupt theme
- capture - fix quic parser crash
- release - libyaml as a dependency
0.19.0 2017/07/11
- NOTICE: Supported ES Versions: 2.4.x, 5.1.2, 5.2.x, > 5.3.1, 5.4.x
- viewer - remove old UI
- viewer - CyberChef integration (must always add hex decoding)
- viewer - spigraph sort and refreshing improvements
- viewer - spiview fixed unique malform url
- viewer - stats allow comma separated list
- capture - rulesFiles and rules support
- capture - fixed daq building
- viewer - ES scrolling didn't work (issue #697)
- easybutton - Upgrade yara, glib, geoip, curl versions
- capture - fixed writer crash with --copy (issue #711)
- viewer - lots of stats tab fixes (issue #629,#655)
- viewer - setting for query on page load (issue #599)
- viewer - don't sort unsortable columns (issue #593)
- viewer - clipboard fixes (issue #707)
0.18.3 2017/05/25
- NOTICE: Supported ES Versions: 2.4.x, 5.1.2, 5.2.x, > 5.3.1, 5.4.x
- viewer - Other decodings (issues #684, #670)
- viewer - Text lineup (issue #598)
- wise - track average running time
- viewer - session graph uses timezone setting
- viewer - fixed cron query creation with forwarding failures
- viewer - new serverSecret instead of passwordSecret for S2S
- viewer - csv export uses visible columns in session table (issue #601)
- viewer - stats page improvements (issue #682)
- viewer - do a better job on quoting expressions (issue #694)
- viewer - remove duplicate TLS section
- viewer - back button works better with new UI
- viewer - fixed connections query size (issue #685)
- viewer - Real SPA (issue #664)
- viewer - Align email header (issue #690)
- viewer - Fixed email query generation (issue #689)
- viewer - spigraph copy/paste (issue #646)
- db - handle _optimize vs _forcemerge
0.18.2 2017/04/16
- NOTICE: Supported ES Versions: 2.4.x, 5.1.2, 5.2.x, > 5.3.1, 5.4.x
- capture - New snapLen variable, by default 16384
- release - Configure improvements
- release - ethtool startup commands moved to moloch_config_interfaces.sh
- viewer - custom themes
- viewer - fix clickable session field off-focusing too easily
- viewer - can cancel spiview loads (issue #637)
- viewer - expose session length in pagination select box (issue #677)
- viewer - fix spiview not updating (issue #656)
- viewer - type ahead fixes/dismiss (issue #591)
- viewer - apply search expression to url (issue #649)
- viewer - display array values in sessions correctly (issue #625)
- viewer - fix broken node display in stats (issue #672)
- viewer - permalink fixes (issue #673)
- viewer - spigraph field typeahead fixes (issues #647)
- viewer - connections field typeahead fixes (issues #675)
- viewer - display when packets are rendering
- viewer - make sorting icons consistent
- viewer - connections tab links are rendered correctly (issue #641)
- viewer - make sure connections popup renders inside view (issue #644)
- capture - support ES basic auth (issue #679)
- release - Configure supports multiple interfaces
- release - only use systemd files if systemctl and /etc/systemd exists
0.18.1 2017/03/28
- NOTICE: Supported ES Versions: 2.4.x, 5.1.2, 5.2.x (5.3.0 is NOT supported)
- release - node 4.8.1, lua 5.3.4, curl 7.53.1, glib2 2.52.0
- capture - handle certs with after dates before the before date
- capture - actually truncate urls, previous fix didn't work (issue #458, #667)
- capture - handle certs with pre epoch times
- capture - more magicMode basic detections
- db - Handle timeouts and nodeNames better with upgrading from db version 30 to 34
- capture - fix race condition when quitting and processing unsaved sessions
0.18.0 2017/03/21
- NOTICE: Upgrading to 0.18 requires an outage for db.pl upgrade (~5 min)
- NOTICE: Must upgrade wiseService BEFORE upgrading moloch-capture.
New 0.18.0 wiseService can be used with older moloch-capture.
- NOTICE: db.pl upgrade REQUIRES *ALL* moloch-capture to be down
- NOTICE: Supported ES Versions: 2.4.x, 5.1.2, 5.2.x (5.3.0 is NOT supported)
ES 5 users READ: https://molo.ch/faq#how_do_i_upgrade_to_es_5x
- NOTICE: 0.18.0 has a new look and feel. Some features have been added, removed,
or temporarily are missing. Feedback using slack or github issues welcome.
- wise - md5 lookups now associated with contentType
- wise - virustotal support
- capture - contentType now sent to wise for md5 lookups
- db - all indices except sessions-* are reindex for ES5 support
- capture - all readers must use batch interface
- multi - fixed tags for new ui /detail and added tests
- viewer - files tab uses new ui
- viewer - users tab uses new ui
- viewer - stats tab uses new ui (/stats.old available temporarily)
- viewer - sessions tab uses new ui (/sessions.old available temporarily)
- viewer - newUI setting removed
- viewer - spiview tab uses new ui (/spiview.old available temporarily)
- viewer - connections tab uses new ui (/connections.old available temporarily)
- capture - pcapWriteMethod=simple-nodirect uses the simple writer without direct
writes. Required for some file systems like zfs
- viewer - spigraph tab uses new ui (/spigraph.old available temporarily)
- capture - tpacketv3 handles multiple interfaces correctly (issue #658)
- easybutton - singlehost and config removed, build remains for now
make install & make config should work
- capture -
0.17.1 2017/01/30
- NOTICE: ES 2.4 or ES 5.1.2 required (ES 5.x isn't recommended for production yet)
ES 5 users READ: https://molo.ch/faq#how_do_i_upgrade_to_es_5x
- NOTICE: Can only update directly from Moloch 0.11.1 or later
- capture - handle missing syn/ack better
- capture - better mongo detection
- db - dstats_2 and stats_v1 now use date for time for kibana support, also prepares for ES 5 upgrade
- capture - some arm64 fixes (issue #584)
- viewer - new settings page
- capture - tpacketv3 no longer requires a bpf
- capture - pfring uses batch packet api
- capture - fix libpcap multiple interface crash (issue #610)
- release - Configure improvements
0.17.0 2017/01/05
- NOTICE: npm update required
- NOTICE: ES 2.4.x required
- NOTICE: Last version that can be updated directly from Moloch 0.11.0 or earlier
- viewer - New sessions UI (newUI=true)
- all - Initial ES 5.0 support (do not use in production!)
- all - Refactor many ES calls to remove depreciated syntax
- viewer - Handle multiple query parameters better
- WISE - basic elasticsearch source
- all - Initial pcap encoding support, variables
* simpleEncoding: aes-256-ctr or xor-2048
* simpleKEKId - The kek id to use from the keks section
* [keks] - A section with multiple kekid=passwords
- capture - Fixed yara 1.7 multithread crash (issue #568)
- capture - Handle frag gre with frag ip inside
- viewer - New Help UI (based on new ui)
- viewer - New bounding select box
- viewer - Fix clicking map not applying query expression
- db - New sync-files which does both add/rm missing faster
- viewer - Add column menus
- viewer - Fix reordering columns
- viewer - Fix unnecessary whitespace when copying values from session table
- viewer - Add IP:Port option to field menus
- viewer - Permalink adds "openAll=1" parameter
- capture - mysql tls parser
- capture - llmnr and mdns
- capture - version command line option prints library versions too
- release - GeoIP 1.6.9, curl 7.52.1, pcap 1.8.1, glib 2.50.2, node 4.6.2
- capture - Use inotify directly since glib2 monitor doesn't expose close write
- capture - support yara 3.5 (issue #521)
- capture - new --op option to set any field (issue #412)
- capture - added dontSaveSPI=1 support to tagger/wise to not save SPI data (issue #505)
- capture - basic kafka, dropbox-lan-sync detection
- capture - new scrubspi plugin
- viewer - Apply user setting timezone
- viewer - Add "EXISTS!" to search expression typeahead results
- viewer - split session spi data and pcap loading into two apis
0.16.1 2016/11/28
- NOTICE: db.pl upgrade is required
- capture - out-of-order and acked-unseen-segment tags
- capture - initial pppoe support (issue #536)
- capture - new timestamp field when record written
- db - new duplicate firstPacket, lastPacket, ipSrc, ipDst, portSrc, portSrc to
make Kibana work better with moloch data.
- db - fix info command
- viewer - don't crash if we can't decode, still might not decode well though (issue #522)
- wise - threatstream sql capture importId and handle stripping hostname for lookups
- capture - new pcapReadMethod of tpacketv3 on linux
- capture - new option magicMode: libmagic, libmagicnotext, molochmagic, basic, none
- capture - The tpacketv3, libpcap* pcapReadMethod now batch packets before adding
to packet queues to reduce mutex lock contention
- wise - Support dos format tagger files
- capture - basic tacacs, flash-policy detection