-
Notifications
You must be signed in to change notification settings - Fork 1
/
Copy path00-RELEASENOTES
4579 lines (3484 loc) · 154 KB
/
00-RELEASENOTES
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
Redis 4.0 release notes
=======================
--------------------------------------------------------------------------------
Upgrade urgency levels:
LOW: No need to upgrade unless there are new features you want to use.
MODERATE: Program an upgrade of the server, but it's not urgent.
HIGH: There is a critical bug that may affect a subset of users. Upgrade!
CRITICAL: There is a critical bug affecting MOST USERS. Upgrade ASAP.
--------------------------------------------------------------------------------
================================================================================
Redis 4.0.9 Released Mon Mar 26 17:52:32 CEST 2018
================================================================================
Upgrade urgency CRITICAL: Critical upgrade for users using AOF with the
fsync policy set to "always".
Dear Redis users,
Redis version 4.0.9 adds a few interesting new features and fixes a very
critical bug regarding the Append Only File. Let's start with the bad news
(the critical bug), explaining what happens and in what conditions:
Critical AOF bug explained
--------------------------
When AOF is enabled with the fsync policy set to "always", we have a
(rarely used) setup where Redis fsyncs every new write on disk. On this
setup Redis MUST reply to the client with an OK code to the write, only
after the write is already persisted on disk.
Because of a bug, in particular conditions, it sometimes happens (verified
experimentally that the condition can be actually created) that in the
same event loop cycle the command is both processed and the reply sent, before
the beforeSleep() function has the ability to fsync the write on disk.
The redis 4.0.9 release fixes this problem introducing the concept of
write barriers in the Redis event loop (ae.c). If you are using a different
AOF setup, like fsync everysec, you are not affected because such guarantee
is not provided anyway. Similarly if you have fsync set to always but you
do not semantically use the fact that the reply is only sent after the
successful fsync, you may avoid upgrading.
Other bugfixes
--------------
Other things that we fixed in this release include:
* Latency monitor could report wrong latencies under certain conditions.
* AOF rewriting could fail when a backgronud rewrite is triggered and
at the same time the AOF is switched on/off.
* Redis Cluster crash-recovery safety improved.
* Other smaller fixes (check commnits).
New features
------------
* Redis Cluster has now the ability to configure certain slaves so that
they'll never attempt a failover.
* Keyspace notifications API in modules.
* RM_Call() is now faster by reusing the same client.
* Tracking of the percentage of keys already logically expired but yet
not evicted.
* Other smaller improvements (check commits)
This is the list of commits composing this release:
zhaozhao.zz in commit 5b722bd7:
fix missed call on freeaddrinfo
1 file changed, 1 insertion(+), 1 deletion(-)
zhaozhao.zz in commit 2551b0f6:
anet: avoid double close
1 file changed, 1 insertion(+), 1 deletion(-)
antirez in commit 8d92885b:
Cluster: add test for the nofailover flag.
2 files changed, 71 insertions(+)
antirez in commit 70597a30:
Cluster: ability to prevent slaves from failing over their masters.
6 files changed, 70 insertions(+), 2 deletions(-)
antirez in commit 16cad10a:
redis-cli: fix missed unit in array. Change define name.
1 file changed, 5 insertions(+), 5 deletions(-)
charsyam in commit 640fa434:
fix-out-of-index-range-for-redis-cli-findbigkey
1 file changed, 6 insertions(+), 4 deletions(-)
antirez in commit 83390f55:
expireIfNeeded() needed a top comment documenting the behavior.
1 file changed, 19 insertions(+)
antirez in commit 888039ca:
expireIfNeeded() comment: claim -> pretend.
1 file changed, 1 insertion(+), 1 deletion(-)
antirez in commit e09c8c10:
Actually use ae_flags to add AE_BARRIER if needed.
1 file changed, 1 insertion(+), 1 deletion(-)
charsyam in commit fb7560bc:
refactoring-make-condition-clear-for-rdb
1 file changed, 2 insertions(+), 2 deletions(-)
antirez in commit 1e2f0d69:
ae.c: insetad of not firing, on AE_BARRIER invert the sequence.
1 file changed, 38 insertions(+), 22 deletions(-)
antirez in commit b2e4aad9:
AOF: fix a bug that may prevent proper fsyncing when fsync=always.
1 file changed, 18 insertions(+), 6 deletions(-)
antirez in commit 93bad8ae:
Cluster: improve crash-recovery safety after failover auth vote.
1 file changed, 3 insertions(+), 2 deletions(-)
antirez in commit e32752e8:
ae.c: introduce the concept of read->write barrier.
2 files changed, 29 insertions(+), 6 deletions(-)
antirez in commit 262f4039:
Fix ziplist prevlen encoding description. See #4705.
1 file changed, 6 insertions(+), 6 deletions(-)
antirez in commit 83923afa:
Track number of logically expired keys still in memory.
3 files changed, 28 insertions(+), 1 deletion(-)
antirez in commit 256ddbf6:
Remove non semantical spaces from module.c.
1 file changed, 36 insertions(+), 41 deletions(-)
antirez in commit 280c3e39:
Fix typo in notifyKeyspaceEvent() comment.
1 file changed, 1 insertion(+), 1 deletion(-)
Dvir Volk in commit 7c4623b0:
Add doc comment about notification flags
1 file changed, 1 insertion(+)
Dvir Volk in commit f4e7502e:
Fix indentation and comment style in testmodule
1 file changed, 92 insertions(+), 98 deletions(-)
Dvir Volk in commit 3c8456c6:
Use one static client for all keyspace notification callbacks
1 file changed, 11 insertions(+), 7 deletions(-)
Dvir Volk in commit aaaff8bd:
Remove the NOTIFY_MODULE flag and simplify the module notification flow if there aren't subscribers
3 files changed, 5 insertions(+), 9 deletions(-)
Dvir Volk in commit 0be51b8f:
Document flags for notifications
1 file changed, 17 insertions(+), 1 deletion(-)
Dvir Volk in commit 3b95c89c:
removed some trailing whitespaces
1 file changed, 2 deletions(-)
Dvir Volk in commit 84c6f1e3:
removed hellonotify.c
3 files changed, 1 insertion(+), 87 deletions(-)
Dvir Volk in commit 53b85e53:
fixed test
1 file changed, 7 insertions(+), 1 deletion(-)
Dvir Volk in commit b43f66c9:
finished implementation of notifications. Tests unfinished
7 files changed, 339 insertions(+), 3 deletions(-)
antirez in commit eddf5deb:
More verbose logging when slave sends errors to master.
1 file changed, 6 insertions(+), 2 deletions(-)
oranagra in commit c09cc0a9:
when a slave experiances an error on commands that come from master, print to the log
1 file changed, 2 insertions(+)
charsyam in commit 5c374f94:
getting rid of duplicated code
1 file changed, 2 insertions(+), 2 deletions(-)
Guy Benoish in commit a64f36e5:
enlarged buffer given to ld2string
3 files changed, 7 insertions(+), 2 deletions(-)
antirez in commit f1705801:
Make it explicit with a comment why we kill the old AOF rewrite.
1 file changed, 3 insertions(+)
Guy Benoish in commit 0c030dea:
rewriteAppendOnlyFileBackground() failure fix
1 file changed, 31 insertions(+), 21 deletions(-)
Oran Agra in commit 58073974:
fix to latency monitor reporting wrong max latency
1 file changed, 1 insertion(+)
================================================================================
Redis 4.0.8 Released Fri Feb 2 11:17:40 CET 2018
================================================================================
Upgrade urgency CRITICAL ONLY for Redis Cluster users. Otherwise no reason
to upgrade at all.
Redis 4.0.8 fixes a single critical bug in the radix tree data structure
used for Redis Cluster keys slot tracking. The problem was actually fixed
10 months ago into unstable, but it was fixed in a commit related to Streams
so it was never backported (for error) into the 4.0 branch.
The problem will crash Redis Cluster instances during deletions, but it is
very hard to trigger: only when the node removed is in the edge of a memory
mapped area there are the conditions to create an issue, because otherwise
the code just accesses an out of range word in read-only way in an allocated
structure: this is almost always harmless.
The single commit in this release:
f603940f Rax updated to latest antirez/rax commit. (Salvatore Sanfilippo)
Cheers,
Salvatore
================================================================================
Redis 4.0.7 Released Wed Jan 24 11:01:40 CET 2018
================================================================================
Upgrade urgency MODERATE: Several bugs fixed, but none of critical level.
Dear Redis Users,
Redis 4.0.7 addresses a number of problems and adds a few things that are
very useful to have and was worth to backport into a patchlevel release.
Here is a list of the most important things, but you can find the full list
of commits below as usually:
* Many 32 bit overflows were addressed in order to allow to use Redis with
a very significant amount of data, memory size permitting. (zhaozhao.zz,
Oran Agra)
* MEMORY USAGE fixed for the list type. (gnuhpc)
* Allow read-only scripts in Redis Cluster. (Salvatore Sanfilippo)
* Fix AOF pipes setup in edge case. (heqin)
* AUTH option for MIGRATE. (AlexStocks, Salvatore Sanfilippo, Fabio Nicotra)
* HyperLogLogs are no longer converted from sparse to dense in order
to be merged. (Salvatore Sanfilippo)
* Fix AOF rewrite dead loop under edge cases. (heqin)
* Fix processing of large bulk strings (>= 2GB). (Oran Agra)
* Added RM_UnlinkKey in modules API. (Dvir Volk)
* Fix Redis Cluster crashes when certain commands with a variable number
of arguments are called in an improper way. (Salvatore Sanfilippo)
* Fix memory leak in lazyfree engine. (zhaozhao.zz)
* Fix many potentially successful partial synchronizations that end
doing a full SYNC, because of a bug destroying the replication
backlog on the slave. So after a failover the slave was often not able
to PSYNC with masters, and a full SYNC was triggered. The bug only
happened after 1 hour of uptime so escaped the unit tests. (Oran Agra)
* Improve anti-affinity in master/slave allocation for Redis Cluster
when the cluster is created. (Salvatore Sanfilippo)
* Improve output buffer handling for slaves, by not limiting the amount
of writes a slave could receive. (Guy Benoish)
The full list of commits follow.
Enjoy,
Salvatore
jianqingdu in commit 2b99d77a:
fix not call va_end when syncWrite() failed
1 file changed, 2 insertions(+), 2 deletions(-)
Yusaku Kaneta in commit 5f9b9e11:
Fix the firstkey, lastkey, and keystep of moduleCommand
1 file changed, 1 insertion(+), 1 deletion(-)
Mark Nunberg in commit ba2d3e8e:
redismodule.h: Check ModuleNameBusy before calling it
1 file changed, 1 insertion(+), 1 deletion(-)
antirez in commit 05c1f18d:
Fix integration test NOREPLICAS error time dependent false positive.
1 file changed, 6 insertions(+), 3 deletions(-)
antirez in commit 4acd6973:
Fix migrateCommand() access of not initialized byte.
1 file changed, 5 insertions(+), 2 deletions(-)
Guy Benoish in commit 548e4fe0:
Replication buffer fills up on high rate traffic.
1 file changed, 7 insertions(+), 2 deletions(-)
antirez in commit efa7063c:
Cluster: improve anti-affinity algo in redis-trib.rb.
1 file changed, 131 insertions(+), 1 deletion(-)
antirez in commit 48568ab6:
Remove useless comment from serverCron().
1 file changed, 2 insertions(+), 3 deletions(-)
heqin in commit 0201dea5:
fixbug for #4545 dead loop aof rewrite
1 file changed, 1 insertion(+), 1 deletion(-)
antirez in commit 926beaa3:
Hopefully more clear comment to explain the change in #4607.
1 file changed, 4 insertions(+), 3 deletions(-)
qinchao in commit 019ad3e2:
fix assert problem in ZIP_DECODE_PREVLENSIZE , see issue: https://github.com/antirez/redis/issues/4587
1 file changed, 1 insertion(+), 1 deletion(-)
Oran Agra in commit 8d9dff84:
PSYNC2 fix - promoted slave should hold on to it's backlog
1 file changed, 5 insertions(+)
zhaozhao.zz in commit fba2e169:
aof: format code and comment
1 file changed, 5 insertions(+), 5 deletions(-)
antirez in commit 7777be7b:
Put more details in the comment introduced by #4601.
1 file changed, 8 insertions(+), 3 deletions(-)
zhaozhao.zz in commit 91c1568b:
lazyfree: fix memory leak for lazyfree-lazy-server-del
1 file changed, 4 insertions(+), 3 deletions(-)
antirez in commit f9c2c1ac:
Fix getKeysUsingCommandTable() in the case of nagative arity.
1 file changed, 7 insertions(+), 5 deletions(-)
antirez in commit 61135f18:
Document new protocol options in #4568 into redis.conf.
1 file changed, 14 insertions(+)
antirez in commit e77fba4d:
proto-max-querybuf-len -> client-query-buffer-limit.
1 file changed, 4 insertions(+), 4 deletions(-)
antirez in commit 87fe813b:
New config options about protocol prefixed with "proto".
4 files changed, 13 insertions(+), 13 deletions(-)
gnuhpc in commit 2e0d2414:
Fix a typo(maybe instruction?) in crash log
1 file changed, 1 insertion(+), 1 deletion(-)
Dvir Volk in commit 9f7e214e:
Added RM_UnlinkKey - a low level analog to UNLINK command
3 files changed, 56 insertions(+)
zhaozhao.zz in commit 947077bb:
redis-benchmark: bugfix - handle zero liveclients in right way
1 file changed, 1 insertion(+), 1 deletion(-)
Oran Agra in commit ff2e628f:
Add config options for max-bulk-len and max-querybuf-len mainly to support RESTORE of large keys
4 files changed, 16 insertions(+), 1 deletion(-)
Oran Agra in commit aefa9caa:
fix processing of large bulks (above 2GB)
8 files changed, 39 insertions(+), 33 deletions(-)
heqin in commit 896cf1a9:
fixbug for #4545 dead loop aof rewrite
1 file changed, 3 insertions(+), 1 deletion(-)
antirez in commit 5abb12e0:
Hyperloglog: refresh hdr variable correctly.
1 file changed, 3 insertions(+), 1 deletion(-)
antirez in commit c39a0f7c:
Hyperloglog: Support for PFMERGE sparse encoding as target.
1 file changed, 14 insertions(+), 3 deletions(-)
antirez in commit 8a012df9:
Hyperloglog: refactoring of sparse/dense add function.
1 file changed, 38 insertions(+), 20 deletions(-)
antirez in commit 549409ff:
Test: MIGRATE AUTH test added.
1 file changed, 24 insertions(+)
antirez in commit 47717222:
Rewrite MIGRATE AUTH option.
1 file changed, 38 insertions(+), 12 deletions(-)
heqin in commit d8da89ea:
fixbug for #4538 Error opening /setting AOF rewrite IPC pipes: No such file or directory
1 file changed, 6 insertions(+), 4 deletions(-)
antirez in commit 4fcc564a:
safe_write -> aofWrite. Function commented.
1 file changed, 9 insertions(+), 2 deletions(-)
zhaozhao.zz in commit 27d9c729:
aof: cast sdslen to ssize_t
1 file changed, 1 insertion(+), 1 deletion(-)
zhaozhao.zz in commit de4fb877:
aof: fix the short write
1 file changed, 22 insertions(+), 1 deletion(-)
Tomasz Poradowski in commit 1fade3d3:
always enable command history in redis-cli
1 file changed, 2 insertions(+), 1 deletion(-)
antirez in commit 9f4d4eef:
Cluster: allow read-only EVAL/EVALSHA in slaves.
1 file changed, 2 insertions(+), 1 deletion(-)
nashe in commit 8eeceabd:
Prevent off-by-one read in stringmatchlen() (fixes #4527)
1 file changed, 1 insertion(+), 1 deletion(-)
gnuhpc in commit 733af148:
Fix memory usage list bug
1 file changed, 1 insertion(+), 1 deletion(-)
zhaozhao.zz in commit c9cb699b:
dict: fix the int problem for defrag
3 files changed, 5 insertions(+), 5 deletions(-)
zhaozhao.zz in commit b37099a1:
dict: fix the int problem
1 file changed, 9 insertions(+), 9 deletions(-)
zhaozhao.zz in commit 8fe586d3:
set: fix the int problem for qsort
1 file changed, 8 insertions(+), 2 deletions(-)
zhaozhao.zz in commit 219e29af:
set: fix the int problem for SPOP & SRANDMEMBER
1 file changed, 2 insertions(+), 2 deletions(-)
================================================================================
Redis 4.0.6 Released Thu Dec 4 17:54:10 CET 2017
================================================================================
Upgrade urgency CRITICAL: More errors in the fixes for PSYNC2 in Redis 4.0.5
were identified.
This release fixes yet more errors present in the 4.0.5 fixes, that could
affect slaves. Moreover another critical issue in quicklists, when they are
used at a massive memory scale, was fixed in this release. Upgrading from
any 4.0.x release, especially if you are running 4.0.4 or 4.0.5, is highly
recommended.
Note that while this fix for 4.0.6 was written in an hurry as well, this
time we took extra precautions in order to avoid writing a broken patch:
1. The code was reviewed by two developers independently.
2. A regression test about the problem introduced in 4.0.4/5 was added.
3. Resisting to duplicated Lua scripts loading into the Lua engine is now
the default action of the loading function, thus it's simpler to stress
its behavior.
4. The code section was tested with Valgrind.
The following is the list of commits included in this release:
zhaozhao.zz in commit 57786b14:
quicklist: change the len of quicklist to unsigned long
2 files changed, 4 insertions(+), 4 deletions(-)
zhaozhao.zz in commit 2211540d:
quicklist: fix the return value of quicklistCount
2 files changed, 2 insertions(+), 2 deletions(-)
antirez in commit c85c84be:
Refactoring: improve luaCreateFunction() API.
3 files changed, 38 insertions(+), 58 deletions(-)
antirez in commit 85b24770:
Remove useless variable check from luaCreateFunction().
1 file changed, 1 insertion(+), 1 deletion(-)
antirez in commit a945e5c0:
Fix issue #4505, Lua RDB AUX field loading of existing scripts.
1 file changed, 9 insertions(+), 3 deletions(-)
antirez in commit 65a2e40a:
Regression test for #4505 (Lua AUX field loading).
1 file changed, 22 insertions(+), 1 deletion(-)
antirez in commit d6c70f22:
DEBUG change-repl-id implemented.
1 file changed, 7 insertions(+)
================================================================================
Redis 4.0.5 Released Thu Dec 1 16:03:32 CET 2017
================================================================================
Upgrade urgency CRITICAL: Redis 4.0.4 fix for PSYNC2 was broken, causing the
slave to crash when receiving an RDB file from the
master that contained a duplicated Lua script.
Please upgrade ASAP if you are with 4.0.4 and you use any form of Lua scripting
because this problem will easily crash Redis.
================================================================================
Redis 4.0.4 Released Thu Nov 30 18:42:12 CET 2017
================================================================================
Upgrade urgency CRITICAL: Several PSYNC2 bugs can corrupt the slave data set
after a restart and a successful PSYNC2 handshake.
This is a quick followup to Redis 4.0.3 since I forgot to add a few fixes...
that are actually described in the 4.0.3 changelog (but not in the list of
commits). Basically it's the following commits, implementing the ability
to persist scripts into RDB files for a successful PSYNC, otherwise a corruption
could happen when a slave is restarted and receives EVALSHA from the master
about scripts it does not know:
8449227f PSYNC2: Fix off by one buffer size in luaCreateFunction().
eeac1d35 PSYNC2: just store script bodies into RDB.
fb0441a8 PSYNC2: luaCreateFunction() should handle NULL client parameter.
0429db3c PSYNC2: Save Lua scripts state into RDB file.
d06fbbdd Regression test: Slave restart with EVALSHA in backlog issue #4483.
ab3d3aca Prevent corruption of server.executable after DEBUG RESTART.
b7c7edf9 Be more verbose when DEBUG RESTART fails.
Please upgrade ASAP to 4.0.4 becuase 4.0.3 had an incomplete set of fixes.
Cheers and sorry for the 4.0.3 fiasco ;-)
Salvatore
================================================================================
Redis 4.0.3 Released Thu Nov 30 13:14:50 CET 2017
================================================================================
Upgrade urgency CRITICAL: Several PSYNC2 bugs can corrupt the slave data set
after a restart and a successful PSYNC2 handshake.
Hi all, Redis 4.0.3 contains several bug fixes to different parts of Redis 4.0,
but the highlight is definitely in the "PSYNC after restart" that the new
RDB format, containing replication metadata information, was able to provide
to Redis 4.0. There were several bugs that are addressed in this release.
Moreover several LFU fixes improve the ability of Redis to correctly estimate
the popularity of keys. This release also fixes important bugs in Redis modules,
including bugs related to replication of modules commands, reloading the same
module multiple times, and other related things. Finally there is even a
security fix related to loading a corrupted Cluster state from a corrupted
file. We advice to upgrade ASAP. Check the list of commits for credits, several
people helped a lot in this release. I'm grateful to each of them.
Cheers,
Salvatore
antirez in commit d766322e:
LFU: Fix LFUDecrAndReturn() to just decrement.
1 file changed, 3 insertions(+), 13 deletions(-)
zhaozhao.zz in commit 6544796a:
LFU: add hotkeys option to redis-cli
1 file changed, 135 insertions(+)
zhaozhao.zz in commit e2355c19:
LFU: do some changes about LFU to find hotkeys
4 files changed, 39 insertions(+), 19 deletions(-)
zhaozhao.zz in commit 22969a13:
LFU: change lfu* parameters to int
2 files changed, 3 insertions(+), 3 deletions(-)
zhaozhao.zz in commit 6b71f714:
LFU: fix the missing of config get and rewrite
1 file changed, 6 insertions(+), 2 deletions(-)
Felix Krause in commit 2090052e:
Update link to https and use inline link
1 file changed, 1 insertion(+), 1 deletion(-)
Bo Cai in commit a75f2025:
redis-cli.c typo: Requets -> Requests.
1 file changed, 1 insertion(+), 1 deletion(-)
Bo Cai in commit 76aab08f:
redis-cli.c typo: helpe -> helper.
1 file changed, 1 insertion(+), 1 deletion(-)
Sébastien Fievet in commit b6fe5074:
Fix some typos
1 file changed, 3 insertions(+), 3 deletions(-)
antirez in commit eda5cb0a:
t_hash.c: clarify calling two times the same function.
1 file changed, 2 insertions(+), 2 deletions(-)
antirez in commit 4a60fbd8:
adlist: fix listJoin() in the case the second list is empty.
1 file changed, 1 insertion(+), 1 deletion(-)
Chris Lamb in commit 060eb3b2:
Correct spelling of "faield".
1 file changed, 1 insertion(+), 1 deletion(-)
antirez in commit 3c942b12:
Improve OBJECT HELP descriptions.
1 file changed, 2 insertions(+), 2 deletions(-)
antirez in commit 6b6a83c7:
Fix entry command table entry for OBJECT for HELP option.
1 file changed, 1 insertion(+), 1 deletion(-)
Itamar Haber in commit 048097ad:
Adds `OBJECT help`
1 file changed, 18 insertions(+), 3 deletions(-)
David Carlier in commit 906134fe:
Fix undefined behavior constant defined.
2 files changed, 10 insertions(+), 2 deletions(-)
rouzier in commit 03657e88:
Fix file descriptor leak and error handling
1 file changed, 6 insertions(+), 3 deletions(-)
Itamar Haber in commit 52fda013:
Prevents `OBJECT freq` with `noeviction`
1 file changed, 2 insertions(+), 2 deletions(-)
Itamar Haber in commit 15bc8e97:
Adds -u <uri> option to redis-cli.
1 file changed, 89 insertions(+)
antirez in commit f30454c1:
Test: regression test for latency expire events logging bug.
1 file changed, 14 insertions(+)
zhaozhao.zz in commit 1e7227f4:
expire & latency: fix the missing latency records generated by expire
1 file changed, 11 insertions(+), 8 deletions(-)
antirez in commit 9524fce0:
Modules: fix memory leak in RM_IsModuleNameBusy().
1 file changed, 3 insertions(+), 7 deletions(-)
antirez in commit 2a27da1c:
PSYNC2: reorganize comments related to recent fixes.
2 files changed, 24 insertions(+), 26 deletions(-)
zhaozhao.zz in commit e0c2a0ec:
PSYNC2: persist cached_master's dbid inside the RDB
1 file changed, 16 insertions(+), 2 deletions(-)
zhaozhao.zz in commit 2eca8aed:
PSYNC2: make repl_stream_db never be -1
1 file changed, 6 insertions(+), 9 deletions(-)
zhaozhao.zz in commit 35942383:
PSYNC2: clarify the scenario when repl_stream_db can be -1
2 files changed, 21 insertions(+), 9 deletions(-)
zhaozhao.zz in commit be1b9ee0:
PSYNC2 & RDB: fix the missing rdbSaveInfo for BGSAVE
1 file changed, 4 insertions(+), 1 deletion(-)
zhaozhao.zz in commit 9f69e179:
PSYNC2: safe free backlog when reach the time limit
1 file changed, 12 insertions(+)
zhaozhao.zz in commit 0205dd01:
Modules: handle the busy module name
2 files changed, 19 insertions(+), 2 deletions(-)
zhaozhao.zz in commit 3cce566e:
Modules: handle the conflict of registering commands
1 file changed, 28 insertions(+), 21 deletions(-)
Oran Agra in commit d01f163c:
fix string to double conversion, stopped parsing on \0 even if the string has more data.
2 files changed, 9 insertions(+), 2 deletions(-)
antirez in commit 9a3e15c6:
Modules: fix for scripting replication of modules commands.
2 files changed, 9 insertions(+), 7 deletions(-)
Yossi Gottlieb in commit fa87879b:
Nested MULTI/EXEC may replicate in different cases.
2 files changed, 10 insertions(+)
zhaozhao.zz in commit bc7076b0:
rehash: handle one db until finished
1 file changed, 5 insertions(+), 2 deletions(-)
kmiku7 in commit 7675b00a:
fix boundary case for _dictNextPower
1 file changed, 1 insertion(+), 1 deletion(-)
Itamar Haber in commit f31d9b12:
Fixes an off-by-one in argument handling of `MEMORY USAGE`
1 file changed, 1 insertion(+), 1 deletion(-)
antirez in commit 897d8571:
SDS: improve sdsRemoveFreeSpace() to avoid useless data copy.
1 file changed, 12 insertions(+), 5 deletions(-)
antirez in commit 1ee6af4d:
Fix saving of zero-length lists.
1 file changed, 3 insertions(+), 2 deletions(-)
antirez in commit 1740300f:
Fix buffer overflows occurring reading redis.conf.
1 file changed, 3 insertions(+)
antirez in commit b25c2451:
Regression test for issue #4391.
1 file changed, 4 insertions(+)
antirez in commit 1847b987:
More robust object -> double conversion.
1 file changed, 8 insertions(+), 4 deletions(-)
antirez in commit c94cd1d8:
Limit statement in RM_BlockClient() to 80 cols.
1 file changed, 5 insertions(+), 4 deletions(-)
Dvir Volk in commit 193e4acc:
Added safety net preventing redis from crashing if a module decide to block in MULTI
1 file changed, 8 insertions(+), 5 deletions(-)
Dvir Volk in commit d131921c:
Renamed GetCtxFlags to GetContextFlags
3 files changed, 11 insertions(+), 11 deletions(-)
Dvir Volk in commit 2e71edcc:
Added support for module context flags with RM_GetCtxFlags
3 files changed, 177 insertions(+)
================================================================================
Redis 4.0.2 Released Thu Sep 21 15:47:53 CEST 2017
================================================================================
Upgrade urgency HIGH: Several potentially critical bugs fixed.
Hello, this release addresses several significant bugs in Redis 4.0:
1. A number of bugs were fixed in the area of PSYNC2 replication in the
specific area of restarting an instance with an RDB file having the
repliacation meta-data to continue without a full resynchronization. The
old code allowed several inconsistencies under certain conditions, like
starting a master with an RDB file generated by a slave, and later using
such master to connect previous slaves having the same replication history.
Because of other bugs, sometimes the replication resulted in a full
synchronization even if actually a partial resynchronization was possible
and so forth. Several commits by different authors fix different bugs here.
2. AOF flush on SHUTDOWN did not cared to really write the AOF buffers
(not in the kernel but in the Redis process memory) to disk before exiting.
Calling SHUTDOWN during traffic resulted into not every operation to be
persisted on disk.
3. The SLOWLOG could reference values inside string objects stored at keys,
creating a race condition during FLUSHALL ASYNC while the DB is reclaimed
in another thread.
There are other smaller bugs addessed in this relase, see the full commit
history below for more information.
A big thank you to all the contributors of this release. Without the
help I received, Redis 4.0 would take a much longer time to mature. It's
a real pleasure to work together with people around the world, while making
Redis better.
antirez in commit 1c60b7a6:
Clarify comment in change fixing #4323.
1 file changed, 6 insertions(+), 2 deletions(-)
zhaozhao.zz in commit 368124e8:
Lazyfree: avoid memory leak when free slowlog entry
1 file changed, 5 insertions(+), 2 deletions(-)
antirez in commit 79567b6e:
PSYNC2: More refinements related to #4316.
2 files changed, 14 insertions(+), 11 deletions(-)
zhaozhao.zz in commit f1194649:
PSYNC2: make persisiting replication info more solid
4 files changed, 33 insertions(+), 9 deletions(-)
antirez in commit 097a5556:
PSYNC2: Fix the way replication info is saved/loaded from RDB.
4 files changed, 49 insertions(+), 23 deletions(-)
antirez in commit f1a2cbfd:
PSYNC2: Create backlog on slave partial sync as well.
1 file changed, 5 insertions(+)
antirez in commit 0c0b77d1:
Add MEMORY DOCTOR to MEMORY HELP.
1 file changed, 3 insertions(+), 1 deletion(-)
Mota in commit fa6bd1b2:
redis-benchmark: default value size usage update.
1 file changed, 2 insertions(+), 2 deletions(-)
jybaek in commit ad0ddcf3:
Remove Duplicate Processing
1 file changed, 1 deletion(-)
Oran Agra (and also Buğra Gedik) in commit 8651e5d5:
Flush append only buffers before existing.
1 file changed, 2 insertions(+), 1 deletion(-)
antirez in commit f2b2897f:
Changelog: note that 4.0 CLUSTER NODES output changed.
1 file changed, 6 insertions(+)
Itamar Haber in commit 363be783:
Changes command stats iteration to being dict-based
1 file changed, 17 insertions(+), 10 deletions(-)
================================================================================
Redis 4.0.1 Released Mon Jul 24 15:51:31 CEST 2017
================================================================================
Upgrade urgency MODERATE: A few serious but non critical bugs in the modules
subsystem. A rare Redis Cluster crash fixed.
Many other minor fixes.
Hi everybody. This is the first patch level release of Redis 4.0, fixing the
obvious last minute issues discovered just after the 4.0.0 GA release, plus
a few other things that were no-brainers. The highlights here in terms
of bug fixing are:
1. Loading two or more modules exporting native data types resulted into the
inability to reload the RDB file.
2. Crash in modules when calling from Lua scripts module commands that would
block.
3. A Redis Cluster crash due to mis-handling of the "migrate-to" internal
flag.
4. Other smaller fixes not worth of a release per se, but nice to add here.
If you upgraded to 4.0 to use modules, definitely a required upgrade.
If you are using Redis Cluster, also a good idea to upgrade.
Otherwise... You can definitely wait for the next one :-)
Cheers,
Salvatore
Here is the commits in detail:
Jan-Erik Rediger in commit a8c2ef76:
Check that the whole first argument is a number
1 file changed, 3 insertions(+), 2 deletions(-)
WuYunlong in commit bfe5008b:
fix rewrite config: auto-aof-rewrite-min-size
1 file changed, 2 insertions(+), 2 deletions(-)
Chris Lamb in commit a6abc216:
Correct proceding -> proceeding typo.
1 file changed, 1 insertion(+), 1 deletion(-)
Byron Grobe in commit 1d901b02:
Fixed issue #1996 (Missing '-' in help message for redis-benchmark)
1 file changed, 1 insertion(+), 1 deletion(-)
Jan-Erik Rediger in commit 19e5e5ea:
Don't use extended Regexp Syntax
1 file changed, 6 insertions(+), 6 deletions(-)
Leon Chen in commit 62474219:
fix return wrong value of clusterDelNodeSlots
1 file changed, 4 insertions(+), 2 deletions(-)
Leon Chen in commit dc782ceb:
fix mismatch argument
1 file changed, 1 insertion(+), 1 deletion(-)
liangsijian in commit 07631ff1:
Fix lua ldb command log
1 file changed, 1 insertion(+)
antirez in commit 41e3617d:
Modules: don't crash when Lua calls a module blocking command.
1 file changed, 12 insertions(+), 2 deletions(-)
antirez in commit 10370b20:
Fix typo in unblockClientFromModule() top comment.
1 file changed, 1 insertion(+), 1 deletion(-)
antirez in commit b6c55a89:
Make representClusterNodeFlags() more robust.
1 file changed, 18 insertions(+), 17 deletions(-)
antirez in commit 9a4f3d72:
Fix two bugs in moduleTypeLookupModuleByID().
1 file changed, 7 insertions(+), 4 deletions(-)
antirez in commit 7302e186:
Allow certain modules APIs only defining REDISMODULE_EXPERIMENTAL_API.
2 files changed, 20 insertions(+), 12 deletions(-)
================================================================================
Redis 4.0.0 Released Fri Jul 14 13:04:44 CEST 2017
================================================================================
Upgrade urgency CRITICAL: 4.0.0 GA fixes many important bugs.
Dear Redis users,
this is the first stable version of Redis 4.0. There are a number
of bug fixes and improvements compared to the previous RC, mainly:
* Different replication fixes to PSYNC2, the new 4.0 replication engine.
* Modules thread safe contexts were introduced. They are an experimental API right now, but the API is considered to be stable and usable when needed.
* SLOWLOG now logs the offending client name and address. Note that this is a backward compatibility breakage in case old code assumes that the slowlog entry is composed of exactly three entries.
* The modules native data types RDB format changed.
* The AOF check utility is now able to deal with RDB preambles.
* GEORADIUS_RO and GEORADIUSBYMEMBER_RO variants, not supporting the STORE option, were added in order to allow read-only scaling of such queries.
* HSET is now variadic, and HMSET is considered deprecated (but will be supported for years to come). Please use HSET in new code.
* GEORADIUS huge radius (>= ~6000 km) corner cases fixed, certain elements near the edges were not returned.
* DEBUG DIGEST modules API added.
* HyperLogLog commands no longer crash on certain input (non HLL) strings.
* Fixed SLAVEOF inside MULTI/EXEC blocks.
* Many other minor bug fixes and improvements.
Note that 4.0 is probably one of the most extreme releases of Redis ever
made in terms of changes inside the internals: all the aggregated data types
no longer use Redis Objects structures but directly SDS objects, certain
deletion operations are now threaded, the replication engine was modified
in many ways. So please handle this release with care. A few patch-level
releases will follow in the next weeks and months fixing the important issues
discovered by the users.
You can read the new set of features below in this file, there are a lot
of improvements that can make a real difference in real world use cases.
Also note that Redis 4.0 is, as usually, almost a perfect superset of Redis
3.2, so it is very rare that compatibility with the past is broken in terms
of exported commands.
IMPORTANT: Redis Cluster users, please note that, as specified in the list
of incompatibilities, Redis 4.0 cluster bus protocol is not compatible with
Redis 3.2, so in order to upgrade, a mass reboot of the instances is needed
and rolling upgrades are not possible. This change was needed in order to
add compatibility for Containers/NAT, where the bus port at a fixed offset
was not an acceptable design, so we had to change many things, resulting
in the incompatible protocol.
Have fun with Redis 4.0!
Salvatore
antirez in commit c29852ff:
Modules: fix thread safe context DB selection.
1 file changed, 3 insertions(+)
antirez in commit b73f186a:
Modules documentation removed from source.
4 files changed, 2830 deletions(-)
antirez in commit 09d93ec9:
Markdown generation of Redis Modules API reference improved.
2 files changed, 83 insertions(+), 74 deletions(-)
antirez in commit 87aabb1a:
Fix replication of SLAVEOF inside transaction.
2 files changed, 19 insertions(+), 3 deletions(-)
antirez in commit 44f89d1d:
CLUSTER GETKEYSINSLOT: avoid overallocating.
1 file changed, 5 insertions(+)
antirez in commit 0df24b68:
Fix isHLLObjectOrReply() to handle integer encoded strings.
1 file changed, 1 insertion(+)
antirez in commit 884ceb69:
Clients blocked in modules: free argv/argc later.
2 files changed, 15 insertions(+), 3 deletions(-)
antirez in commit ccbdd762:
Event loop: call after sleep() only from top level.
2 files changed, 4 insertions(+), 2 deletions(-)
antirez in commit 10925e46:
redis-check-aof: tell users there is a --fix option.
1 file changed, 2 insertions(+), 1 deletion(-)
Guy Benoish in commit 99bb1c74:
Modules: Fix io->bytes calculation in RDB save
1 file changed, 55 insertions(+), 30 deletions(-)