forked from apache/mesos
-
Notifications
You must be signed in to change notification settings - Fork 1
/
CHANGELOG
3879 lines (3495 loc) · 230 KB
/
CHANGELOG
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
Release Notes - Mesos - Version 1.0.1
--------------------------------------------
* This is a bug fix release.
All Issues:
** Bug
* [MESOS-5388] - MesosContainerizerLaunch flags execute arbitrary commands via shell.
* [MESOS-5911] - Webui redirection to leader in browser does not work.
* [MESOS-5913] - Stale socket FD usage when using libevent + SSL.
* [MESOS-5922] - mesos-agent --help exit status is 1
* [MESOS-5923] - Ubuntu 14.04 LTS GPU Isolator "/run" directory is noexec.
* [MESOS-5927] - Unable to run "scratch" Dockerfiles with Unified Containerizer.
* [MESOS-5928] - Agent's '--version' flag doesn't work
* [MESOS-5930] - Orphan tasks can shown up as running after they have finished.
* [MESOS-5943] - Incremental http parsing of URLs leads to decoder error.
* [MESOS-5945] - NvidiaVolume::create() should check for root before creating volume.
* [MESOS-5959] - All non-root tests fail on GPU machine.
* [MESOS-5982] - NvidiaVolume errors out if any Nvidia binary is missing.
Release Notes - Mesos - Version 1.0.0
--------------------------------------------
This release contains the following new features:
* Scheduler and Executor v1 HTTP APIs are now considered stable.
* [MESOS-4791] - **Experimental** support for v1 Master and Agent APIs. These
APIs let operators and services (monitoring, load balancers) send HTTP
requests to '/api/v1' endpoint on master or agent. See
`docs/operator-http-api.md` for details.
* [MESOS-4828] - **Experimental** support for a new `disk/xfs' isolator
has been added to isolate disk resources more efficiently. Please refer to
docs/mesos-containerizer.md for more details.
* [MESOS-4355] - **Experimental** support for Docker volume plugin. We added a
new isolator 'docker/volume' which allows users to use external volumes in
Mesos containerizer. Currently, the isolator interacts with the Docker
volume plugins using a tool called 'dvdcli'. By speaking the Docker volume
plugin API, most of the Docker volume plugins are supported.
* [MESOS-4641] - **Experimental** A new network isolator, the
`network/cni` isolator, has been introduced in the `MesosContainerizer`. The
`network/cni` isolator implements the Container Network Interface (CNI)
specification proposed by CoreOS. With CNI the `network/cni` isolator is
able to allocate a network namespace to Mesos containers and attach the
container to different types of IP networks by invoking network drivers
called CNI plugins.
* [MESOS-2948, MESOS-5403] - The authorizer interface has been refactored in
order to decouple the ACLs definition language from the interface.
It additionally includes the option of retrieving `ObjectApprover`. An
`ObjectApprover` can be used to synchronously check authorizations for a
given object and is hence useful when authorizing a large number of objects
and/or large objects (which need to be copied using request based
authorization). NOTE: This is a **breaking change** for authorizer modules.
* [MESOS-5405] - The `subject` and `object` fields in authorization::Request
have been changed from required to optional. If either of these fields is
not set, the request should only be authorized if any subject/object should
be allowed.
NOTE: This is a semantic change for authorizer modules.
* [MESOS-4931, MESOS-5709, MESOS-5704] - Authorization based HTTP endpoint
filtering enables operators to restrict what part of the cluster state a
user is authorized to see.
Consider for example the `/state` master endpoint: an operator can now
authorize users to only see a subset of the running frameworks, tasks, or
executors. The following endpoints support HTTP endpoint filtering:
'/state', '/state-summary', '/tasks', '/frameworks','/weights',
and '/roles'. Additonally the following v1 API calls support filtering:
'GET_ROLES','GET_WEIGHTS','GET_FRAMEWORKS', 'GET_STATE', and 'GET_TASKS'.
* [MESOS-4909] - Tasks can now specify a kill policy. They are best-effort,
because machine failures or forcible terminations may occur. Currently, the
only available kill policy is how long to wait between graceful and forcible
task kill. In the future, more policies may be available (e.g. hitting an
HTTP endpoint, running a command, etc). Note that it is the executor's
responsibility to enforce kill policies. For executor-less command-based
tasks, the kill is performed via sending a signal to the task process:
SIGTERM for the graceful kill and SIGKILL for the forcible kill. For docker
executor-less tasks the grace period is passed to 'docker stop --time'. This
feature supersedes the '--docker_stop_timeout', which is now deprecated.
* [MESOS-4908] - The task kill policy defined within 'TaskInfo' can now be
overridden when the scheduler kills the task. This can be used by schedulers
to forcefully kill a task which is already being killed, e.g. if something
went wrong during a graceful kill and a forcible kill is desired. Note that
it is the executor's responsibility to honor the 'Event.kill.kill_policy'
field and override the task's kill policy and kill policy from a previous
kill task request. To use this feature, schedulers and executors must
support HTTP API; use the '--http_command_executor' agent flag to ensure
the agent launches the HTTP API based command executor.
* [MESOS-4949] - The executor shutdown grace period can now be configured in
`ExecutorInfo`, which overrides the agent flag. When shutting down an
executor the agent will wait in a best-effort manner for the grace period
specified here before forcibly destroying the container. The executor must
not assume that it will always be allotted the full grace period, as the
agent may decide to allot a shorter period and failures / forcible
terminations may occur. Together with kill policies this gives frameworks
flexibility around how to clean up tasks and executors.
* [MESOS-3094] - **Experimental** support for launching mesos tasks on
Windows. Note that there are no isolation guarantees provided yet.
* [MESOS-4090] - The `mesos.native` python module has been split into two,
`mesos.executor` and `mesos.scheduler`. This change also removes
un-necessary 3rd party dependencies from `mesos.executor` and
`mesos.scheduler`. `mesos.native` still exists, combining both modules for
backwards compatibility with existing code.
* [MESOS-1478] - Phase I of the Slave to Agent rename is complete. To support
the rename, new duplicate flags (e.g., --agent_reregister_timeout), new
binaries (e.g., mesos-agent) and WebUI sandbox links have been added. All
the logging output has been updated to use the term 'agent' now. Flags,
binaries and scripts with 'slave' keyword have been deprecated (see
"Deprecations section below").
* [MESOS-4312] - **Experimental** support for building and running mesos on
IBM PowerPC platform.
* [MESOS-4189] - Weights for resource roles can now be configured dynamically
via the new '/weights' endpoint on the master.
* [MESOS-4424] - Support for using Nvidia GPUs as a resource in the
Mesos "unified" containerizer. This support includes running containers
with and without filesystem isolation (i.e. running both imageless
containers as well as containers using a docker image). Frameworks must
opt-in to receiving GPU resources via the GPU_RESOURCES framework
capability (see the scarce resource problem in MESOS-5377). We support
'nvidia-docker'-style docker containers by injecting a volume that
contains the Nvidia libraries / binaries when the docker image has
the 'com.nvidia.volumes.needed' label. Support for the docker
containerizer will come in a future release.
* [MESOS-5724] - SSL certificate validation allows for additional IP address
subject alternative name extension verification.
Deprecations:
* [MESOS-2281] - Deprecated the plain text format for credentials in favor of
the JSON format.
* [MESOS-4910] - Deprecate the --docker_stop_timeout agent flag.
* [MESOS-5001] - The 'allocator/event_queue_dispatches' metric is now
deprecated in favor 'of allocator/mesos/event_queue_dispatches'.
* [MESOS-5029] - Deprecated the ExecutorInfo.source field in favor of
ExecutorInfo.labels.
* [MESOS-3781] - Deprecated flags with keyword 'slave' in favor of 'agent'.
* [MESOS-3779] - Deprecated sandbox links with 'slave' keyword in the WebUI.
* [MESOS-3784] - Deprecated `slave` subcommand for mesos-cli.
* [MESOS-5155] - Deprecated `SetQuota` and `RemoveQuota` ACLs. This change is
applicable to the local authorizer as well as any custom authorizer module.
* [MESOS-5666] - Deprecated camel cased `taskInfo` and `executorInfo` in
isolator `ContainerConfig`.
* [MESOS-5863] - Deprecated `SSL_*` environment variables used by libprocess
SSL support in favor of using `LIBPROCESS_SSL_*`.
Additional API Changes:
* [MESOS-4580] - Returning `202` (Accepted) for /reserve and related endpoints.
* [MESOS-4735] - Added 'output_file' field to CommandInfo.URI in Scheduler API
and v1 Scheduler HTTP API.
* [MESOS-5014] - Changed Call and Event Type enums in scheduler.proto
from required to optional for the purpose of backwards compatibility.
* [MESOS-5015] - Changed Call and Event Type enums in executor.proto
from required to optional for the purpose of backwards compatibility.
* [MESOS-5029] - Added 'labels' to ExecutorInfo.
* [MESOS-5030] - Added non-terminal task metadata to the container resource
usage information.
* [MESOS-5408] - Deleted the /observe HTTP endpoint.
* [MESOS-4843, MESOS-5150, MESOS-5286, MESOS-5335, MESOS-5336] - Authorization
has been added to the '/metrics/snapshot', '/logging/toggle', '/quota',
'/files/browse', '/files/download', '/files/read', '/flags', and
'/containers' endpoints. If a Mesos cluster has authorization enabled, these
endpoints now require that ACLs be set to authorize principals to access
them. Note that the '/metrics/snapshot' and '/files/*' endpoints are used by
the web UI, and thus using the web UI in a cluster with authorization
enabled will require that ACLs be set appropriately.
* [MESOS-5064] - Remove default value for the agent `work_dir`. This flag is
now required, and the agent will exit immediately if it is not provided.
* [MESOS-5637] - Authorized endpoints consistently return `503` (Service
Unavailable) instead of `500` (Internal Server Error) when the authenticator
or the authorizer fails to process the request.
* [MESOS-5657] - Executors should not inherit environment variables from the
agent.
* [MESOS-5680] - We should not 'chown -R' on persistent volumes every time
container tries to use it.
* [MESOS-5642] - Namespace and header file of `Allocator` has been moved to
be consistent with other packages.
* [MESOS-5851] - The flag `--authenticate_http` has been deprecated in favor
of `--authenticate_http_readwrite`. This new flag enables authentication for
all HTTP endpoints which support authentication and allow modification of
the state of the cluster. A new flag has also been added,
`--authenticate_http_readonly`, which enables authentication for those
authenticatable endpoints that cannot be used to modify the cluster state.
* [MESOS-5833] - Disable the experimental `registry_strict` master flag.
3rd Party Upgrades:
* [MESOS-4805] - Upgraded vendored ry-http-parser-1c3624a to nodejs/http-parser 2.6.1.
* [MESOS-4678] - Upgraded vendored protobuf 2.5.0 to 2.6.1.
* [MESOS-4803] - Upgraded vendored libev 4.15 to 4.22.
* [MESOS-4612] - Upgraded vendored ZooKeeper 3.4.5 to 3.4.8.
Binary API Changes:
* [MESOS-5055] - Slave/Agent Rename Phase I - Update strings in the log message
and standard output.
* [MESOS-3782] - Slave/Agent Rename Phase I - Duplicate/Rename binaries.
* [MESOS-5057] - Slave/Agent Rename Phase I - Update strings in error messages and
other strings.
* [MESOS-5230] - Slave/Agent Rename Phase I: Rename '/include/mesos/slave' folder
All Issues:
** Bug
* [MESOS-1495] - Create separate local data file to manage releases
* [MESOS-1575] - master sets failover timeout to 0 when framework requests a high value
* [MESOS-1865] - Redirect to the leader master when current master is not a leader
* [MESOS-2043] - Framework auth fail with timeout error and never get authenticated
* [MESOS-2198] - Document that TaskIDs should not be reused
* [MESOS-2201] - ReplicaTest.Restore fails with leveldb greater than v1.7.
* [MESOS-2331] - MasterSlaveReconciliationTest.ReconcileRace is flaky
* [MESOS-2858] - FetcherCacheHttpTest.HttpMixed is flaky.
* [MESOS-3181] - Implement package rebundling for Windows
* [MESOS-3319] - Mesos will not build when configured with gperftools enabled
* [MESOS-3402] - mesos-execute does not support credentials
* [MESOS-3573] - Mesos does not kill orphaned docker containers
* [MESOS-3714] - `os::environ` collides with the `environ` macro in Windows headers.
* [MESOS-3737] - `limiter.hpp` causes template specialization error on Windows 10/MSVC 1900
* [MESOS-3739] - Mesos does not set Content-Type for 400 Bad Request
* [MESOS-3881] - Implement `stout/os/pstree.hpp` on Windows
* [MESOS-3902] - The Location header when non-leading master redirects to leading master is incomplete.
* [MESOS-3923] - Implement AuthN handling in Master for the Scheduler endpoint
* [MESOS-3976] - C++ HTTP Scheduler Library does not work with SSL enabled
* [MESOS-4099] - parallel make tests does not build all test targets
* [MESOS-4269] - Minor typo in src/linux/cgroups.cpp
* [MESOS-4279] - Docker executor truncates task's output when the task is killed.
* [MESOS-4387] - Added a new test cases for reviveOffers in allocator test
* [MESOS-4434] - Install 3rdparty package boost, glog, protobuf and picojson when installing Mesos
* [MESOS-4447] - Renamed reserved() API to reservations()
* [MESOS-4462] - Port `gmtime_r`
* [MESOS-4463] - Implement `hsterror`
* [MESOS-4464] - Implement cpu count facilities on Windows
* [MESOS-4465] - Implement pagesize facilities in Windows
* [MESOS-4466] - Implement `waitpid` in Windows
* [MESOS-4469] - Implement memory querying in Windows
* [MESOS-4470] - Implement `uname` in Windows
* [MESOS-4471] - Implement process querying/counting in Windows
* [MESOS-4472] - Implement `getenv` in Windows
* [MESOS-4473] - Implement `shell` in Windows
* [MESOS-4474] - Implement `sendfile` in Windows
* [MESOS-4580] - Consider returning `202` (Accepted) for /reserve and related endpoints
* [MESOS-4611] - Passing a lambda to dispatch() always matches the template returning void
* [MESOS-4633] - Tests will dereference stack allocated agent objects upon assertion/expectation failure.
* [MESOS-4634] - Tests will dereference stack allocated master objects upon assertion/expectation failure.
* [MESOS-4658] - process::Connection can lead to process::wait deadlock
* [MESOS-4662] - PortMapping network isolator should not assume BIND_MOUNT_ROOT is a realpath.
* [MESOS-4672] - Implement aufs based provisioner backend.
* [MESOS-4673] - Agent fails to shutdown after re-registering period timed-out.
* [MESOS-4680] - HTTP requests to non leading mesos-master redirect to top level page
* [MESOS-4684] - Create base docker image for test suite.
* [MESOS-4705] - Linux 'perf' parsing logic may fail when OS distribution has perf backports.
* [MESOS-4744] - mesos-execute should allow setting role
* [MESOS-4807] - IOTest.BufferedRead writes to the current directory
* [MESOS-4810] - ProvisionerDockerPullerTest.ROOT_INTERNET_CURL_ShellCommand fails.
* [MESOS-4827] - Destroy Docker container crashes Mesos slave
* [MESOS-4875] - overlayfs does not work when lauching tasks
* [MESOS-4876] - bind backend does not work when launching tasks
* [MESOS-4885] - Unzip should force overwrite
* [MESOS-4901] - Build fails on some systems due to unportable use of time.h
* [MESOS-4911] - Executor driver does not respect executor shutdown grace period.
* [MESOS-4912] - LinuxFilesystemIsolatorTest.ROOT_MultipleContainers fails.
* [MESOS-4922] - Setup proper /etc/hostname, /etc/hosts and /etc/resolv.conf for containers in network/cni isolator.
* [MESOS-4924] - MAC OS build failed
* [MESOS-4942] - Docker runtime isolator tests may cause disk issue.
* [MESOS-4950] - Implement reconnect funtionality in the scheduler library.
* [MESOS-4952] - Annoying image provisioner logging for when images are not used.
* [MESOS-4954] - URI fetcher error message if plugin is not found is mis-leading.
* [MESOS-4957] - Typo in Mesos portal
* [MESOS-4961] - ContainerLoggerTest.LOGROTATE_RotateInSandbox is flaky
* [MESOS-4963] - Incorrect CXXFLAGS with GCC 6
* [MESOS-4972] - Implement `os::rename`
* [MESOS-4978] - Update mesos-execute with Appc changes.
* [MESOS-4981] - Framework (re-)register metric counters broken for calls made via scheduler driver
* [MESOS-4984] - MasterTest.SlavesEndpointTwoSlaves is flaky
* [MESOS-5000] - MasterTest.MasterLost is flaky
* [MESOS-5005] - Enforce that DiskInfo principal is equal to framework/operator principal
* [MESOS-5010] - Installation of mesos python package is incomplete
* [MESOS-5012] - Protobuf change for external storage.
* [MESOS-5013] - Add docker volume driver isolator for Mesos containerizer.
* [MESOS-5018] - FrameworkInfo Capability enum does not support upgrades.
* [MESOS-5031] - Authorization Action enum does not support upgrades.
* [MESOS-5060] - Requesting /files/read.json with a negative length value causes subsequent /files requests to 404.
* [MESOS-5063] - SSLTest.HTTPSPost and SSLTest.HTTPSGet tests fail
* [MESOS-5064] - Remove default value for the agent `work_dir`
* [MESOS-5082] - Fix a bug in the Nvidia GPU device isolator that exposes a discrepancy between clang and gcc in 'using' declarations
* [MESOS-5113] - `network/cni` isolator crashes when launched without the --network_cni_plugins_dir flag
* [MESOS-5114] - Flags::parse does not handle empty string correctly.
* [MESOS-5115] - Grant access to /dev/nvidiactl and /dev/nvidia-uvm in the Nvidia GPU isolator.
* [MESOS-5121] - pivot_root is not available on PowerPC
* [MESOS-5125] - Commit message hook iterates over words, rather than lines.
* [MESOS-5126] - Commit message hook iterates over the commented lines.
* [MESOS-5127] - Reset `LIBPROCESS_IP` in `network\cni` isolator.
* [MESOS-5128] - PersistentVolumeTest.AccessPersistentVolume is flaky
* [MESOS-5131] - Slave allows the resource estimator to send non-revocable resources.
* [MESOS-5132] - Commit message hook lints the diff in verbose mode.
* [MESOS-5138] - Fix Nvidia GPU test build for namespace change of MasterDetector
* [MESOS-5142] - Add agent flags for HTTP authorization.
* [MESOS-5146] - MasterAllocatorTest/1.RebalancedForUpdatedWeights is flaky.
* [MESOS-5153] - Sandboxes contents should be protected from unauthorized users
* [MESOS-5162] - Commit message hook behaves incorrectly when a message includes a "*".
* [MESOS-5166] - ExamplesTest.DynamicReservationFramework is slow
* [MESOS-5181] - Master should reject calls from the scheduler driver if the scheduler is not connected.
* [MESOS-5184] - Mesos does not validate role info when framework registered with specified role
* [MESOS-5196] - Sandbox GC shouldn't return early in the face of an error.
* [MESOS-5199] - The mesos-execute prints confusing message when launching tasks.
* [MESOS-5216] - Document docker volume driver isolator.
* [MESOS-5224] - buffer overflow error in slave upon processing malformed UUIDs
* [MESOS-5225] - Command executor can not start when joining a CNI network
* [MESOS-5226] - The image-less task launched by mesos-execute can not join CNI network
* [MESOS-5230] - Slave/Agent Rename Phase I: Rename '/include/mesos/slave' folder
* [MESOS-5233] - python packages installation is broken
* [MESOS-5237] - The windows version of `os::access` has differing behavior than the POSIX version.
* [MESOS-5239] - Persistent volume DockerContainerizer support assumes proper mount propagation setup on the host.
* [MESOS-5240] - Command executor may escalate after the task is reaped.
* [MESOS-5244] - Compilation failure on Ubuntu 16.04
* [MESOS-5253] - Isolator cleanup should not be invoked if they are not prepared yet.
* [MESOS-5263] - pivot_root is not available on ARM
* [MESOS-5265] - Update mesos-execute to support docker volume isolator.
* [MESOS-5266] - add test cases for docker volume driver
* [MESOS-5277] - Need to add REMOVE semantics to the copy backend
* [MESOS-5279] - DRF sorter add/activate doesn't check if it's adding a duplicate entry
* [MESOS-5282] - Destroy container while provisioning volume images may lead to a race.
* [MESOS-5287] - boto is no longer a Mesos dependency.
* [MESOS-5293] - Endpoint handlers for master and agent are implemented surprisingly differently.
* [MESOS-5294] - Status updates after a health check are incomplete or invalid
* [MESOS-5295] - The task launched by non-checkpointed HTTP command executor will keep running till executor shutdown grace period (5s) after agent process exits.
* [MESOS-5304] - /metrics/snapshot endpoint help disappeared on agent.
* [MESOS-5308] - ROOT_XFS_QuotaTest.NoCheckpointRecovery failed.
* [MESOS-5312] - Env `MESOS_SANDBOX` is not set properly for command tasks that changes rootfs.
* [MESOS-5318] - Make `os::close` always catch structured exceptions on Windows
* [MESOS-5326] - Error symbolic link of include/slave
* [MESOS-5330] - Agent should backoff before connecting to the master
* [MESOS-5340] - libevent builds may prevent new connections
* [MESOS-5341] - Enabled docker volume support for DockerContainerizer
* [MESOS-5351] - DockerVolumeIsolatorTest.ROOT_INTERNET_CURL_CommandTaskRootfsWithVolumes is flaky
* [MESOS-5354] - Update "driver" as optional for DockerVolume.
* [MESOS-5359] - The scheduler library should have a delay before initiating a connection with master.
* [MESOS-5380] - Killing a queued task can cause the corresponding command executor to never terminate.
* [MESOS-5381] - Network portmapping isolator disable IPv6 failed
* [MESOS-5382] - Implement os::fsync
* [MESOS-5383] - Implement os::setHostname
* [MESOS-5386] - Add `HANDLE` overloads for functions that take a file descriptor
* [MESOS-5389] - docker containerizer should prefix relative volume.container_path values with the path to the sandbox.
* [MESOS-5390] - v1 Executor Protos not included in maven jar
* [MESOS-5397] - Slave/Agent Rename Phase 1: Update terms in the website
* [MESOS-5403] - Introduce ObjectApprover Interface to Authorizer.
* [MESOS-5405] - Make fields in authorization::Request protobuf optional.
* [MESOS-5407] - Slave/Agent rename: diagrams in docs
* [MESOS-5408] - Delete the /observe HTTP endpoint
* [MESOS-5413] - `network/cni` isolator should skip the bind mounting of the CNI network information root directory if possible
* [MESOS-5414] - configure failed on ubuntu and centos
* [MESOS-5415] - bootstrap of libprocess fails.
* [MESOS-5416] - make check of stout fails.
* [MESOS-5422] - Website README.md is out of dated
* [MESOS-5423] - Updating the website section in release-guide is out of dated
* [MESOS-5428] - Update the mechanism to define flags in FlagsBase derived clases
* [MESOS-5429] - Enhance error message for mesos-ps
* [MESOS-5432] - Javadoc in project website didn't include the generated protobuf
* [MESOS-5434] - Incomplete bootstrap 3.3.6 upgrade in webui
* [MESOS-5436] - GPU resource broke framework data table in webUI
* [MESOS-5437] - AppC appc_simple_discovery_uri_prefix is lost in configuration.md
* [MESOS-5438] - Add more verbose log for mesos-cat, mesos-tail or mesos-scp
* [MESOS-5445] - Allow libprocess/stout to build without first doing `make` in 3rdparty.
* [MESOS-5449] - Memory leak in SchedulerProcess.declineOffer
* [MESOS-5450] - Make the SASL dependency optional.
* [MESOS-5451] - Show Framework ID in log for long-lived-framework
* [MESOS-5453] - CNI should not store subnet of address in NetworkInfo
* [MESOS-5477] - Implement GET_HEALTH Call in v1 master API.
* [MESOS-5478] - Implement GET_HEALTH Call in v1 agent API.
* [MESOS-5479] - Implement GET_VERSION Call in v1 master API.
* [MESOS-5480] - Implement GET_VERSION Call in v1 agent API.
* [MESOS-5531] - Re-enable style-check for stout.
* [MESOS-5537] - http v1 SUBSCRIBED scheduler event always has nil http_interval_seconds
* [MESOS-5543] - /dev/fd is missing in the Mesos containerizer environment
* [MESOS-5554] - Change major/minor device types for Nvidia GPUs to `unsigned int`
* [MESOS-5556] - Fix method of populating device entries for `/dev/nvidia-uvm`, etc.
* [MESOS-5561] - Need to remove references to "messages/messages.hpp" from `State` API
* [MESOS-5571] - Scheduler JNI throws exception when the major versions of JAR and libmesos don't match
* [MESOS-5575] - Attempting to Parse PID logging is too verbose
* [MESOS-5577] - Modules using replicated log state API require zookeeper headers
* [MESOS-5587] - FullFrameworkWriter makes master segmentation fault.
* [MESOS-5595] - GMock warning in FaultToleranceTest.SchedulerReregisterAfterFailoverTimeout
* [MESOS-5600] - DRF sorter unnecessarily re-sorts due to misuse of "dirty" bit.
* [MESOS-5601] - DRF sorter does not re-calculate share if a client weight is updated.
* [MESOS-5607] - Refactored overlay, overlayfs and aufs checking to fs::supported
* [MESOS-5609] - Put initial scaffolding in place for implementing SUBSCRIBE call on v1 Master API.
* [MESOS-5611] - Error message is not clear when create docker volume with absolute path
* [MESOS-5615] - When using command executor, the ExecutorInfo is useless for sandbox authorization
* [MESOS-5616] - Add missing comments for GET_FLAGS, GET_HEALTH, GET_VERSION, GET_LOGGING_LEVEL, GET_LEADING_MASTER
* [MESOS-5627] - Quota-related authorization actions should be removed rather than deprecated.
* [MESOS-5629] - Agent segfaults after request to '/files/browse'
* [MESOS-5637] - Authorized endpoint results are inconsistent for failures.
* [MESOS-5642] - Move include/mesos/v1/master/allocator.proto to its own directory and package
* [MESOS-5657] - Executors should not inherit environment variables from the agent.
* [MESOS-5660] - ContainerizerTest.ROOT_CGROUPS_BalloonFramework fails because executor environment isn't inherited
* [MESOS-5664] - Invalid resources sent to '/reserve' are silently dropped
* [MESOS-5667] - CniIsolatorTest.ROOT_INTERNET_CURL_LaunchCommandTask fails on CentOS 7.
* [MESOS-5668] - Add CGROUP namespace to linux ns helper.
* [MESOS-5669] - CNI isolator should not return failure if /etc/hostname does not exist on host.
* [MESOS-5670] - MemoryPressureMesosTest.CGROUPS_ROOT_SlaveRecovery is flaky.
* [MESOS-5671] - MemoryPressureMesosTest.CGROUPS_ROOT_Statistics is flaky.
* [MESOS-5673] - Port mapping isolator may cause segfault if it bind mount root does not exist.
* [MESOS-5674] - Port mapping isolator may fail in 'isolate' method.
* [MESOS-5680] - We should not 'chown -R' on persistent volumes every time container tries to use it.
* [MESOS-5684] - Master captures `this` when creating authorization callback
* [MESOS-5685] - The /files/download endpoint's authorization can be compromised
* [MESOS-5691] - SSL downgrade support will leak sockets in CLOSE_WAIT status
* [MESOS-5692] - Add helper function "begin_with/end_with" to strings
* [MESOS-5695] - Add missing comments for GET_ROLES, GET_WEIGHTS, SUBSCRIBE, CREATE_VOLUMES, DESTROY_VOLUMES, SET_QUOTA
* [MESOS-5698] - Quota sorter not updated for resource changes at agent.
* [MESOS-5715] - Enhance startsWith/endsWith's performance
* [MESOS-5723] - SSL-enabled libprocess will leak incoming links to forks
* [MESOS-5724] - SSL certificate validation should allow IP only verification.
* [MESOS-5727] - Command executor health check does not work when the task specifies container image.
* [MESOS-5748] - Potential segfault in `link` and `send` when linking to a remote process
* [MESOS-5755] - NVML headers are not installed as part of 3rdparty install with --enable-install-module-dependencies
* [MESOS-5757] - Authorize orphaned tasks
* [MESOS-5760] - MAC OS Build failed
* [MESOS-5763] - Task stuck in fetching is not cleaned up after --executor_registration_timeout.
* [MESOS-5766] - Missing License Information for Bundled NVML headers
* [MESOS-5794] - Agent's /containers endpoint should skip terminated executors.
* [MESOS-5799] - docker::inspect() may get wrong output when a docker container is not in "running" state
* [MESOS-5806] - CNI isolator should prepare network related /etc/* files for containers using host mode but specify container images.
* [MESOS-5834] - Mesos may pass --volume-driver to the Docker daemon multiple times.
* [MESOS-5844] - PersistentVolumeEndpointsTest.OfferCreateThenEndpointRemove test is flaky
* [MESOS-5845] - The fetcher can access any local file as root
* [MESOS-5848] - Docker health checks are malformed.
* [MESOS-5851] - Create mechanism to control authentication between different HTTP endpoints
* [MESOS-5863] - Enabling SSL causes fetcher fail to fetch from HTTPS sites.
* [MESOS-5891] - /help endpoint does not set Content-Type to HTML.
** Documentation
* [MESOS-4381] - Improve upgrade compatibility documentation.
* [MESOS-4514] - Document how to implement Mesos HTTP operator endpoints.
* [MESOS-4689] - Design doc for v1 Operator API
* [MESOS-4726] - Document scheduler driver calls in framework development guide.
* [MESOS-4750] - Document: Mesos Executor expects all SSL_* environment variables to be set
* [MESOS-4785] - Reorganize ACL subject/object descriptions.
* [MESOS-4787] - HTTP endpoint docs should use shorter paths
* [MESOS-5215] - Update the documentation for '/reserve' and '/create-volumes'
* [MESOS-5313] - Failed to set quota and update weight according to document
* [MESOS-5366] - Update documentation to include contender/detector module
* [MESOS-5419] - Document all known client libraries for the Scheduler/Executor API
* [MESOS-5583] - Improve authorization documentation when setting permissive flag.
* [MESOS-5586] - Move design docs from wiki to web page
* [MESOS-5702] - CNI documentation example is not explicit enough about external plugins
** Epic
* [MESOS-1478] - Slave to Agent rename (Phase I).
* [MESOS-2297] - Add authentication support for HTTP API
* [MESOS-2948] - Generalize authorizer interface in order to allow for arbitrary Subjects, Actions and Objects
* [MESOS-4189] - Dynamic weights
* [MESOS-4843] - Authorize Master Operator Endpoints
* [MESOS-4847] - Agent HTTP Authentication
* [MESOS-4931] - Authorization based filtering for endpoints.
* [MESOS-5150] - Authorize Agent HTTP Endpoints
* [MESOS-5703] - Authorize operator endpoints for Mesos 1.0
** Improvement
* [MESOS-1571] - Signal escalation timeout is not configurable.
* [MESOS-2145] - Distinguish frameworks according to their state in the webui
* [MESOS-2154] - Port CFS quota support to Docker Containerizer
* [MESOS-2281] - Deprecate plain text Credential format.
* [MESOS-2372] - Test script for verifying compatibility between Mesos components
* [MESOS-2602] - Provide a way to "push" cluster state updates to a registered service.
* [MESOS-2720] - Publish the schema for operator endpoints
* [MESOS-3243] - Replace NULL with nullptr
* [MESOS-3690] - Make Apache Mesos' website mobile friendly
* [MESOS-3774] - Migrate Future tests from process_tests.cpp to future_tests.cpp
* [MESOS-3775] - MasterAllocatorTest.SlaveLost is slow.
* [MESOS-4090] - Create light-weight executor only and scheduler only mesos eggs
* [MESOS-4126] - Construct the error string in `MethodNotAllowed`.
* [MESOS-4160] - Log recover tests are slow.
* [MESOS-4164] - MasterTest.RecoverResources is slow.
* [MESOS-4165] - MasterTest.MasterInfoOnReElection is slow.
* [MESOS-4166] - MasterTest.LaunchCombinedOfferTest is slow.
* [MESOS-4167] - MasterTest.OfferTimeout is slow.
* [MESOS-4170] - OversubscriptionTest.UpdateAllocatorOnSchedulerFailover is slow.
* [MESOS-4171] - OversubscriptionTest.RemoveCapabilitiesOnSchedulerFailover is slow.
* [MESOS-4174] - HookTest.VerifySlaveLaunchExecutorHook is slow.
* [MESOS-4175] - ContentType/SchedulerTest.Decline is slow.
* [MESOS-4309] - Update documentation to cover HTTP authentication.
* [MESOS-4353] - Limit the number of processes created by libprocess
* [MESOS-4369] - Enhance DockerExecuter to support Docker's user-defined networks
* [MESOS-4386] - Deprecate 'authenticate' master flag in favor of 'authenticate_frameworks' flag
* [MESOS-4576] - Introduce a stout helper for "which"
* [MESOS-4610] - MasterContender/MasterDetector should be loadable as modules
* [MESOS-4612] - Update vendored ZooKeeper to 3.4.8
* [MESOS-4678] - Upgrade vendored Protobuf to 2.6.1
* [MESOS-4720] - Add allocator metrics for total vs offered/allocated resources.
* [MESOS-4721] - Expose allocation algorithm latency via a metric.
* [MESOS-4722] - Add allocator metric for number of active offer filters
* [MESOS-4723] - Add allocator metric for currently satisfied quotas
* [MESOS-4724] - Add allocator metric for currrent dominant shares of frameworks and roles
* [MESOS-4735] - CommandInfo.URI should allow specifying target filename
* [MESOS-4790] - Revert external linkage of symbols in master/constants.hpp
* [MESOS-4801] - Updated `createFrameworkInfo` for hierarchical_allocator_tests.cpp.
* [MESOS-4802] - Update leveldb patch file to suport PowerPC LE
* [MESOS-4803] - Update vendored libev to 4.22
* [MESOS-4805] - Update ry-http-parser-1c3624a to nodejs/http-parser 2.6.1
* [MESOS-4839] - Move placement new processes into the freezer cgroup into a parent hook.
* [MESOS-4868] - PersistentVolumeTests do not need to set up ACLs.
* [MESOS-4879] - Update glog patch to support PowerPC LE
* [MESOS-4886] - Support mesos containerizer force_pull_image option.
* [MESOS-4891] - Add a '/containers' endpoint to the agent to list all the active containers.
* [MESOS-4897] - Update test cases to support PowerPC LE
* [MESOS-4902] - Add authentication to libprocess endpoints
* [MESOS-4908] - Tasks cannot be killed forcefully.
* [MESOS-4909] - Introduce kill policy for tasks.
* [MESOS-4910] - Deprecate the --docker_stop_timeout agent flag.
* [MESOS-4914] - ProcessorManager delegate should be an Option<string>, not just a string.
* [MESOS-4926] - Add a list parser for comma separated integers in flags.
* [MESOS-4928] - Remove all '.get().' calls on Option / Try variables in the resources abstraction.
* [MESOS-4943] - Reduce the size of LinuxRootfs in tests.
* [MESOS-4949] - Executor shutdown grace period should be configurable.
* [MESOS-4951] - Enable actors to pass an authentication realm to libprocess
* [MESOS-4956] - Add authentication to /files endpoints
* [MESOS-5001] - Prefix allocator metrics with "mesos/" to better support custom allocator metrics.
* [MESOS-5002] - Reflecting the Tachyon => Alluxio rename in the documentation.
* [MESOS-5014] - Call and Event Type enums in scheduler.proto should be optional
* [MESOS-5015] - Call and Event Type enums in executor.proto should be optional
* [MESOS-5020] - Drop `404 Not Found` and `307 Temporary Redirect` in the scheduler library.
* [MESOS-5029] - Add labels to ExecutorInfo
* [MESOS-5030] - Expose TaskInfo's metadata to ResourceUsage struct
* [MESOS-5044] - Temporary directories created by environment->mkdtemp cleanup can be problematic.
* [MESOS-5049] - Refactore subproces setup functions.
* [MESOS-5062] - Update the long-lived-framework example to run on test clusters
* [MESOS-5069] - Upgrade http-parser to v2.6.2
* [MESOS-5073] - Mesos allocator leaks role sorter and quota role sorters.
* [MESOS-5101] - Add CMake build to docker_build.sh
* [MESOS-5117] - Enhance mesos-execute for specifying CNI networks
* [MESOS-5124] - TASK_KILLING is not supported by mesos-execute.
* [MESOS-5155] - Consolidate authorization actions for quota.
* [MESOS-5168] - Benchmark overhead of authorization based filtering.
* [MESOS-5169] - Introduce new Authorizer Actions for Authorized based filtering of endpoints.
* [MESOS-5170] - Adapt json creation for authorization based endpoint filtering.
* [MESOS-5174] - Update the balloon-framework to run on test clusters
* [MESOS-5179] - Enhance the error message for Duration flag.
* [MESOS-5212] - Allow any principal in ReservationInfo when HTTP authentication is off
* [MESOS-5214] - Populate FrameworkInfo.principal for authenticated frameworks
* [MESOS-5271] - Add alias support for Flags
* [MESOS-5273] - Need support for Authorization information via HELP.
* [MESOS-5286] - Add authorization to libprocess HTTP endpoints
* [MESOS-5296] - Split Resource and Inverse offer protobufs for V1 API
* [MESOS-5302] - Consider adding an Executor Shim/Adapter for the new/old API
* [MESOS-5307] - Sandbox mounts should not be in the host mount namespace.
* [MESOS-5316] - Authenticate the agent's '/containers' endpoint.
* [MESOS-5317] - Authorize the agent's '/containers' endpoint.
* [MESOS-5331] - Some cleanup in filesystem_isolator_tests.cpp
* [MESOS-5335] - Add authorization to GET /weights.
* [MESOS-5336] - Add authorization to GET /quota.
* [MESOS-5338] - Add `user` to `Task` protobuf message.
* [MESOS-5339] - Create Tests for testing fine-grained HTTP endpoint filtering.
* [MESOS-5347] - Enhance the log message when launching mesos containerizer.
* [MESOS-5348] - Enhance the log message when launching docker containerizer.
* [MESOS-5350] - Add asynchronous hook for validating docker containerizer tasks
* [MESOS-5356] - Add Windows support for StopWatch
* [MESOS-5360] - Set death signal for dvdcli subprocess in docker volume isolator.
* [MESOS-5370] - Add deprecation support for Flags
* [MESOS-5372] - Add random() to os:: namespace
* [MESOS-5373] - Remove `Zookeeper's` NTDDI_VERSION define
* [MESOS-5374] - Add support for Console Ctrl handling in `slave.cpp`
* [MESOS-5375] - Implement stout/os/windows/kill.hpp
* [MESOS-5398] - Rewrite os::read() to be friendlier to reading binary files
* [MESOS-5399] - Add utility for parsing ld.so.cache on linux.
* [MESOS-5400] - Add preliminary support for parsing ELF files in stout.
* [MESOS-5401] - Add ability to inject a Volume of Nvidia libraries/binaries into a docker-image container in mesos containerizer.
* [MESOS-5404] - Allow `Task` to be authorized.
* [MESOS-5420] - Implement os::exists for processes
* [MESOS-5424] - Update the style of code under website folder to match other exist source code
* [MESOS-5430] - Design the improvement of the home page of mesos.apache.org
* [MESOS-5431] - Update the website generation and development workflows with docker.
* [MESOS-5435] - Add default implementations to all Isolator virtual functions
* [MESOS-5452] - Agent modules should be initialized before all components except firewall.
* [MESOS-5456] - Master anonymous modules should initialized before any other components.
* [MESOS-5457] - Create a small testing doc for the v1 Scheduler/Executor API
* [MESOS-5459] - Update RUN_TASK_WITH_USER to use additional metadata
* [MESOS-5519] - Refresh Mesos project website homepage
* [MESOS-5532] - Maven build is too verbose for batch builds
* [MESOS-5540] - Support building with non-GNU libc
* [MESOS-5550] - Remove Nvidia GPU Isolator's link-time dependence on `libnvidia-ml`
* [MESOS-5551] - Move the Nvidia GPU isolator from `cgroups/devices/gpu/nvidia` to `gpu/nvidia`
* [MESOS-5552] - Bundle NVML headers for Nvidia GPU support.
* [MESOS-5555] - Always provide access to NVIDIA control devices within containers (if GPU isolation is enabled).
* [MESOS-5557] - Add `NvidiaGpuAllocator` component for cross-containerizer GPU allocation
* [MESOS-5558] - Update `Containerizer::resources()` to use the `NvidiaGpuAllocator`
* [MESOS-5559] - Integrate the `NvidiaGpuAllocator` into the `NvidiaGpuIsolator`
* [MESOS-5562] - Add class to share Nvidia-specific components between containerizers
* [MESOS-5563] - Rearrange Nvidia GPU files to cleanup semantics for header inclusion.
* [MESOS-5572] - Change Operator API RPC handlers return type to http::Response
* [MESOS-5576] - Masters may drop the first message they send between masters after a network partition
* [MESOS-5581] - Guarantee ordering between Isolators
* [MESOS-5592] - Pass NetworkInfo to CNI Plugins
* [MESOS-5593] - Devolve v1 operator protos before using them in Master/Agent.
* [MESOS-5617] - Mesos website preview incorrect in facebook
* [MESOS-5618] - Added a metric indicating if replicated log for the registrar has recovered or not.
* [MESOS-5630] - Change build to always enable Nvidia GPU support for Linux
* [MESOS-5636] - Display allocated resources in the agent listing of the webui.
* [MESOS-5666] - Deprecate camel case proto field in isolator ContainerConfig.
* [MESOS-5697] - Support file volume in mesos containerizer.
* [MESOS-5737] - Expose Executor PID in containers endpoint
* [MESOS-5740] - Consider adding `relink` functionality to libprocess
* [MESOS-5743] - Added a flag parser for hashset<std::string>.
* [MESOS-5749] - Have maven run in batch mode
* [MESOS-5753] - Command executor should use `mesos-containerizer launch` to launch user task.
* [MESOS-5758] - Add ability to exclude resources from fair sharing.
* [MESOS-5765] - Add 'systemGetDriverVersion' to NVML abstraction.
* [MESOS-5767] - Add ELFIO as bundled Dependency to Mesos
* [MESOS-5768] - Reimplement the stout ELF abstraction in terms of ELFIO
* [MESOS-5769] - Add get_abi_version() to ELF abstraction in stout
* [MESOS-5782] - Renamed 'commands' to 'pre_exec_commands' in ContainerLaunchInfo.
* [MESOS-5787] - Add ability to set framework capabilities in 'mesos-execute'
* [MESOS-5793] - Add ability to inject Nvidia devices into a container
* [MESOS-5833] - Disable '--registry_strict' master flag
** Task
* [MESOS-338] - Mesos 1.0
* [MESOS-2257] - Version the Operator/Admin API
* [MESOS-2408] - Slave should reclaim storage for destroyed persistent volumes.
* [MESOS-2950] - Implement current mesos Authorizer in terms of generalized Authorizer interface
* [MESOS-3063] - Add an example framework using dynamic reservation
* [MESOS-3103] - Separate OS-specific code in the libprocess library
* [MESOS-3214] - Replace boost foreach with range-based for
* [MESOS-3368] - Add device support in cgroups abstraction
* [MESOS-3371] - Implement process::subprocess on Windows
* [MESOS-3436] - Port dynamiclibrary_test.cpp to Windows
* [MESOS-3438] - Port gzip_test to Windows
* [MESOS-3439] - Port ip_tests
* [MESOS-3443] - Windows: Port protobuf_tests.hpp
* [MESOS-3541] - Add CMakeLists that builds the Mesos master
* [MESOS-3558] - Implement HTTPCommandExecutor that uses the Executor Library
* [MESOS-3559] - Make the Command Scheduler use the HTTP Scheduler Library
* [MESOS-3609] - Port slave/gc.cpp
* [MESOS-3610] - Port slave/flags.cpp to Windows
* [MESOS-3611] - Port slave/http.cpp to Windows
* [MESOS-3612] - Port slave/metrics.cpp to Windows
* [MESOS-3614] - Port slave/slave.cpp to Windows
* [MESOS-3616] - Port slave/status_update_manager.cpp to Windows
* [MESOS-3617] - Port slave/containerizer/containerizer.cpp to Windows
* [MESOS-3618] - Port slave/containerizer/fetcher.cpp
* [MESOS-3619] - Port slave/containerizer/isolator.cpp to Windows
* [MESOS-3620] - Create slave/containerizer/isolators/filesystem/windows.cpp
* [MESOS-3622] - Port slave/containerizer/launcher.cpp to Windows
* [MESOS-3623] - Port slave/containerizer/mesos/containerizer.cpp to Windows
* [MESOS-3624] - Port slave/containerizer/mesos/launch.cpp to Windows
* [MESOS-3634] - Port process/protobuf.hpp
* [MESOS-3635] - Port process/defer.hpp to Windows
* [MESOS-3636] - Port process/dispatch.hpp
* [MESOS-3637] - Port process/process.hpp to Windows
* [MESOS-3639] - Implement stout/os/windows/killtree.hpp
* [MESOS-3641] - Implement stout/os/windows/read.hpp and write.hpp
* [MESOS-3642] - Implement stout/os/windows/sendfile.hpp
* [MESOS-3646] - Port process/clock.hpp to Windows
* [MESOS-3647] - Port process/time.hpp to Windows
* [MESOS-3648] - Port stout/duration.hpp to Windows
* [MESOS-3649] - Port process/future.hpp to Windows
* [MESOS-3650] - Port process/event.hpp to Windows
* [MESOS-3651] - Port process/latch.hpp to Windows
* [MESOS-3652] - Port process/http.hpp to Windows
* [MESOS-3653] - Port process/message.hpp to Windows
* [MESOS-3654] - Port process/filter.hpp to Windows
* [MESOS-3657] - Port process/deferred.hpp to Windows
* [MESOS-3661] - Port slave/metrics.hpp to Windows
* [MESOS-3662] - Port slave/slave.hpp to Windows
* [MESOS-3663] - Port process/metrics/gauge.hpp to Windows
* [MESOS-3664] - Port process/metrics/metric.hpp to Windows
* [MESOS-3666] - Port process/metrics/metrics.hpp to Windows
* [MESOS-3668] - Port process/delay.hpp to Windows
* [MESOS-3669] - Port process/clock.hpp to Windows
* [MESOS-3670] - Port process/time.hpp to Windows
* [MESOS-3671] - Port stout/duration.hpp to Windows
* [MESOS-3672] - Port process/timer.hpp to Windows
* [MESOS-3673] - Port process/timeout.hpp to Windows
* [MESOS-3674] - Port process/async.hpp to Windows
* [MESOS-3675] - Port process/check.hpp to Windows
* [MESOS-3679] - Port slave/containerizer/containerizer.hpp to Windows
* [MESOS-3680] - Port process/subprocess.hpp to Windows
* [MESOS-3681] - Port slave/containerizer/fetcher.hpp to Windows
* [MESOS-3682] - Port slave/containerizer/launcher.hpp to Windows
* [MESOS-3683] - Port slave/containerizer/isolator.hpp to Windows
* [MESOS-3685] - Port process/io.hpp to Windows
* [MESOS-3779] - Slave/Agent Rename Phase I - Update terms in Web UI.
* [MESOS-3781] - Replace Master/Slave Terminology Phase I - Rename flag names and deprecate old ones
* [MESOS-3782] - Slave/Agent Rename Phase I - Add duplicate binaries (or create symlinks)
* [MESOS-3783] - Replace Master/Slave Terminology Phase I - Update documentation
* [MESOS-3784] - Replace Master/Slave Terminology Phase I - Update mesos-cli
* [MESOS-3854] - Finalize design for generalized Authorizer interface
* [MESOS-3945] - Add operator documentation for /weight endpoint
* [MESOS-4033] - Add a commit hook for non-ascii characters.
* [MESOS-4112] - Clean up libprocess gtest macros
* [MESOS-4214] - Introduce HTTP endpoint /weights for updating weight
* [MESOS-4316] - Support get non-default weights by /weights
* [MESOS-4459] - Implement AuthN handling on the scheduler library
* [MESOS-4623] - Add a stub Nvidia GPU isolator.
* [MESOS-4624] - Add allocation metrics for "gpus" resources.
* [MESOS-4625] - Implement Nvidia GPU isolation w/o filesystem isolation enabled.
* [MESOS-4626] - Support Nvidia GPUs with filesystem isolation enabled in mesos containerizer.
* [MESOS-4629] - Implement fault tolerance tests for the HTTP Scheduler API.
* [MESOS-4704] - Enable zlib on Windows.
* [MESOS-4758] - Add a 'name' field into NetworkInfo.
* [MESOS-4759] - Add network/cni isolator for Mesos containerizer.
* [MESOS-4761] - Add agent flags to allow operators to specify CNI plugin and config directories.
* [MESOS-4764] - The network/cni isolator should report assigned IP address.
* [MESOS-4771] - Document the network/cni isolator.
* [MESOS-4788] - Mesos UI should show the role and principal of a framework
* [MESOS-4797] - Add a couple of registrar tests for /weights endpoint
* [MESOS-4813] - Implement base tests for unified container using local puller.
* [MESOS-4818] - Add end to end testing for Appc images.
* [MESOS-4840] - Remove internal usage of deprecated ShutdownFramework ACL
* [MESOS-4844] - Add authentication to master endpoints
* [MESOS-4849] - Add agent flags for HTTP authentication
* [MESOS-4850] - Add authentication to agent endpoints /state and /flags
* [MESOS-4858] - Make changes to executor v1 library around managing connections.
* [MESOS-4860] - Add a script to install the Nvidia GDK on a host.
* [MESOS-4861] - Add configure flags to build with Nvidia GPU support.
* [MESOS-4863] - Add Nvidia GPU isolator tests.
* [MESOS-4864] - Add flag to specify available Nvidia GPUs on an agent's command line.
* [MESOS-4865] - Add GPUs as an explicit resource.
* [MESOS-4881] - Rescind all outstanding offers after changing some weights.
* [MESOS-4887] - Design doc for Slave/Agent rename
* [MESOS-4889] - Implement runtime isolator tests.
* [MESOS-4906] - Upgrade to clang-format-3.8.
* [MESOS-4932] - Propose Design for Authorization based filtering for endpoints.
* [MESOS-4933] - Registrar HTTP Authentication.
* [MESOS-4934] - Enable HELP to include authentication status of endpoint.
* [MESOS-4938] - Support docker registry authentication
* [MESOS-4939] - Support specifying per-container docker registry.
* [MESOS-4944] - Improve overlay backend so that it's writable
* [MESOS-4962] - Support for Mesos releases
* [MESOS-4982] - Update example long running to use v1 API.
* [MESOS-4993] - FetcherTest.ExtractZipFile assumes `unzip` is installed
* [MESOS-5050] - Design Linux capability support for Mesos containerizer
* [MESOS-5055] - Slave/Agent Rename Phase I - Update strings in the log message and standard output
* [MESOS-5057] - Slave/Agent Rename Phase I - Update strings in error messages and other strings
* [MESOS-5065] - Support docker private registry default docker config.
* [MESOS-5108] - Design a short-term solution for a typed error handling mechanism.
* [MESOS-5109] - Capture the error code in `ErrnoError` and `WindowsError`.
* [MESOS-5110] - Introduce an additional template parameter to `Try` for typed error.
* [MESOS-5111] - Update `network::connect` to use the typed error state of `Try`.
* [MESOS-5112] - Introduce `WindowsSocketError`.
* [MESOS-5130] - Enable `newtork/cni` isolator in `MesosContainerizer` as the default `network` isolator.
* [MESOS-5135] - Update existing documentation to Include references to GPUs as a first class resource.
* [MESOS-5136] - Update the default JSON representation of a Resource to include GPUs
* [MESOS-5137] - Remove 'dashboard.js' from the webui.
* [MESOS-5152] - Add authentication to agent's /monitor/statistics endpoint
* [MESOS-5157] - Update webui for GPU metrics
* [MESOS-5159] - Add test to verify error when requesting fractional GPUs
* [MESOS-5164] - Add authorization to agent's /monitor/statistics endpoint.
* [MESOS-5167] - Add tests for `network/cni` isolator
* [MESOS-5171] - Expose state/state.hpp to public headers
* [MESOS-5173] - Allow master/agent to take multiple modules manifest files
* [MESOS-5178] - Add logic to validate for non-fractional GPU requests in the master
* [MESOS-5209] - Add a slave hook that runs after the fetching is done.
* [MESOS-5222] - Create a benchmark for scale testing HTTP frameworks
* [MESOS-5249] - Update CMake files to reflect reorganized 3rdparty
* [MESOS-5250] - Move 3rdparty/libprocess/3rdparty/* to 3rdparty/
* [MESOS-5256] - Add support for per-containerizer resource enumeration
* [MESOS-5257] - Add autodiscovery for GPU resources
* [MESOS-5272] - Support docker image labels.
* [MESOS-5297] - Add authorization to the master's "/flags" endpoint.
* [MESOS-5365] - Introduce a timeout for docker volume driver mount/unmount operation.
* [MESOS-5394] - Rename isolator name 'xfs/disk' and 'posix/disk' to 'disk/xfs' and 'disk/du'
* [MESOS-5474] - Implement GET_FLAGS Call in v1 master API.
* [MESOS-5475] - Implement GET_FLAGS Call in v1 agent API.
* [MESOS-5484] - Implement GET_METRICS Call in v1 master API.
* [MESOS-5485] - Implement GET_LOGGING_LEVEL Call in v1 master API.
* [MESOS-5486] - Implement SET_LOGGING_LEVEL Call in v1 master API.
* [MESOS-5487] - Implement LIST_FILES Call in v1 master API.
* [MESOS-5489] - Implement GET_STATE Call in v1 master API.
* [MESOS-5491] - Implement GET_AGENTS Call in v1 master API.
* [MESOS-5492] - Implement GET_FRAMEWORKS Call in v1 master API.
* [MESOS-5493] - Implement GET_TASKS Call in v1 master API.
* [MESOS-5494] - Implement GET_ROLES Call in v1 master API.
* [MESOS-5495] - Implement GET_WEIGHTS Call in v1 master API.
* [MESOS-5496] - Implement UPDATE_WEIGHTS Call in v1 master API.
* [MESOS-5497] - Implement GET_MASTER Call in v1 master API.
* [MESOS-5498] - Implement SUBSCRIBE Call in v1 master API.
* [MESOS-5499] - Implement RESERVE_RESOURCES Call in v1 master API.
* [MESOS-5500] - Implement UNRESERVE_RESOURCES Call in v1 master API.
* [MESOS-5501] - Implement CREATE_VOLUMES Call in v1 master API.
* [MESOS-5502] - Implement DESTROY_VOLUMES Call in v1 master API.
* [MESOS-5503] - Implement GET_MAINTENANCE_STATUS Call in v1 master API.
* [MESOS-5504] - Implement GET_MAINTENANCE_SCHEDULE Call in v1 master API.
* [MESOS-5505] - Implement UPDATE_MAINTENANCE_SCHEDULE Call in v1 master API.
* [MESOS-5506] - Implement START_MAINTENANCE Call in v1 master API.
* [MESOS-5507] - Implement STOP_MAINTENANCE Call in v1 master API.
* [MESOS-5508] - Implement GET_QUOTA Call in v1 master API.
* [MESOS-5509] - Implement SET_QUOTA Call in v1 master API.
* [MESOS-5510] - Implement REMOVE_QUOTA Call in v1 master API.
* [MESOS-5511] - Implement GET_METRICS Call in v1 agent API.
* [MESOS-5512] - Implement GET_LOGGING_LEVEL Call in v1 agent API.
* [MESOS-5513] - Implement SET_LOGGING_LEVEL Call in v1 agent API.
* [MESOS-5514] - Implement LIST_FILES Call in v1 agent API.
* [MESOS-5517] - Implement GET_RESOURCE_STATISTICS Call in v1 agent API.
* [MESOS-5518] - Implement GET_CONTAINERS Call in v1 agent API.
* [MESOS-5549] - Document aufs provisioner backend.
* [MESOS-5628] - `QuotaHandler` should only make one authorization request to the authorizer.
* [MESOS-5634] - Add Framework Capability for GPU_RESOURCES
* [MESOS-5639] - Add documentation about metadata for CNI plugins.
* [MESOS-5641] - Update docker-volume.md to add some content for how to test
* [MESOS-5663] - Remove hard dependence on libelf for Linux
* [MESOS-5699] - Create new documentation for Mesos networking.
* [MESOS-5704] - Fine-grained authorization on /frameworks
* [MESOS-5705] - ZK credential is exposed in /flags and /state
* [MESOS-5706] - GET_ENDPOINT_WITH_PATH authz doesn't make sense for /flags
* [MESOS-5707] - LocalAuthorizer should error if passed a GET_ENDPOINT ACL with an unhandled path
* [MESOS-5708] - Add authz to /files/debug
* [MESOS-5709] - Authorization for /roles
* [MESOS-5711] - Update AUTHORIZATION strings in endpoint help
* [MESOS-5712] - Document exactly what is handled by GET_ENDPOINTS_WITH_PATH acl
* [MESOS-5750] - Implement GET_EXECUTORS Call in v1 master API.
* [MESOS-5764] - Whitelist the nvidia-uvm-tools device in the Nvidia GPU isolator.
Release Notes - Mesos - Version 0.28.3
--------------------------------------
* This is a bug fix release.
All Issues:
** Bug
* [MESOS-5673] - Port mapping isolator may cause segfault if it bind mount root does not exist.
* [MESOS-5330] - Agent should backoff before connecting to the master.
* [MESOS-5543] - /dev/fd is missing in the Mesos containerizer environment.
* [MESOS-5691] - SSL downgrade support will leak sockets in CLOSE_WAIT status.
* [MESOS-5723] - SSL-enabled libprocess will leak incoming links to forks.
* [MESOS-5748] - Potential segfault in `link` when linking to a remote process.
* [MESOS-5073] - Mesos allocator leaks role sorter and quota role sorters.
* [MESOS-5698] - Quota sorter not updated for resource changes at agent.
* [MESOS-5740] - Consider adding `relink` functionality to libprocess.
* [MESOS-5576] - Masters may drop the first message they send between masters after a network partition.
* [MESOS-5913] - Stale socket FD usage when using libevent + SSL.
* [MESOS-5927] - Unable to run "scratch" Dockerfiles with Unified Containerizer.
* [MESOS-5943] - Incremental http parsing of URLs leads to decoder error.
Release Notes - Mesos - Version 0.28.2
--------------------------------------
* This is a bug fix release.
All Issues:
** Bug
* [MESOS-4705] - Linux 'perf' parsing logic may fail when OS distribution has perf backports.
* [MESOS-5239] - Persistent volume DockerContainerizer support assumes proper mount propagation setup on the host.
* [MESOS-5253] - Isolator cleanup should not be invoked if they are not prepared yet.
* [MESOS-5282] - Destroy container while provisioning volume images may lead to a race.
* [MESOS-5312] - Env `MESOS_SANDBOX` is not set properly for command tasks that changes rootfs.
* [MESOS-4885] - Unzip should force overwrite.
* [MESOS-5449] - Memory leak in SchedulerProcess.declineOffer.
* [MESOS-5380] - Killing a queued task can cause the corresponding command executor to never terminate.
** Improvement
* [MESOS-5307] - Sandbox mounts should not be in the host mount namespace.
Release Notes - Mesos - Version 0.28.1
--------------------------------------
* This is a bug fix release.
All Issues:
** Bug
* [MESOS-4662] - PortMapping network isolator should not assume BIND_MOUNT_ROOT is a realpath.
* [MESOS-4874] - overlayfs does not work with kernel 4.2.3
* [MESOS-4877] - Mesos containerizer can't handle top level docker image like "alpine" (must use "library/alpine")
* [MESOS-4878] - Task stuck in TASK_STAGING when docker fetcher failed to fetch the image
* [MESOS-4964] - curl based docker fetcher fails to decode chunked encoding
* [MESOS-4985] - Destroy a container while it's provisioning can lead to leaked provisioned directories.
* [MESOS-5009] - local docker puller fails to find private registry repositories
* [MESOS-5018] - FrameworkInfo Capability enum does not support upgrades.
* [MESOS-5021] - Memory leak in subprocess when 'environment' argument is provided.
* [MESOS-5023] - MesosContainerizerProvisionerTest.DestroyWhileProvisioning is flaky.
* [MESOS-5114] - Flags::parse does not handle empty string correctly.
Release Notes - Mesos - Version 0.28.0
--------------------------------------
This release contains the following new features:
* [MESOS-4343] - A new cgroups isolator for enabling the net_cls subsystem in
Linux. The cgroups/net_cls isolator allows operators to provide network
performance isolation and network segmentation for containers within a Mesos
cluster. To enable the cgroups/net_cls isolator, append `cgroups/net_cls` to
the `--isolation` flag when starting the slave. Please refer to
docs/mesos-containerizer.md for more details.
* [MESOS-4687] - The implementation of scalar resource values (e.g., "2.5
CPUs") has changed. Mesos now reliably supports resources with up to three
decimal digits of precision (e.g., "2.501 CPUs"); resources with more than
three decimal digits of precision will be rounded. Internally, resource math
is now done using a fixed-point format that supports three decimal digits of
precision, and then converted to/from floating point for input and output,
respectively. Frameworks that do their own resource math and manipulate
fractional resources may observe differences in roundoff error and numerical
precision.
* [MESOS-4479] - Reserved resources can now optionally include "labels".
Labels are a set of key-value pairs that can be used to associate metadata
with a reserved resource. For example, frameworks can use this feature to
distinguish between two reservations for the same role at the same agent
that are intended for different purposes.
* [MESOS-2840] - **Experimental** support for container images in Mesos
containerizer (a.k.a. Unified Containerizer). This allows frameworks to
launch Docker/Appc containers using Mesos containerizer without relying on
docker daemon (engine) or rkt. The isolation of the containers is done using
isolators. Please refer to docs/container-image.md for currently supported
features and limitations.
* [MESOS-4793] - **Experimental** support for v1 Executor HTTP API. This
allows executors to send HTTP requests to the /api/v1/executor agent
endpoint without the need for an executor driver. Please refer to
docs/executor-http-api.md for more details.
* [MESOS-4370] Added support for service discovery of Docker containers that
use Docker Remote API v1.21.
Additional API Changes:
* [MESOS-4066] - Agent should not return partial state when a request is made
to /state endpoint during recovery.
* [MESOS-4547] - Introduce TASK_KILLING state.
* [MESOS-4712] - Remove 'force' field from the Subscribe Call in v1
Scheduler API.
* [MESOS-4591] - Change the object of ReserveResources and CreateVolume ACLs
to `roles`.
* [MESOS-3583] - Add stream IDs for HTTP schedulers.
* [MESOS-4427] - Ensure ip_address in state.json (from NetworkInfo) is valid.
All Issues:
** Bug
* [MESOS-1187] - precision errors with allocation calculations
* [MESOS-1469] - No output from review bot on timeout
* [MESOS-2007] - AllocatorTest/0.SlaveReregistersFirst is flaky
* [MESOS-2017] - Segfault with "Pure virtual method called" when tests fail
* [MESOS-3273] - EventCall Test Framework is flaky
* [MESOS-3397] - sorter.cpp: Check failed: total.resources.contains(slaveId)
* [MESOS-3413] - Docker containerizer does not symlink persistent volumes into sandbox
* [MESOS-3570] - Make Scheduler Library use HTTP Pipelining Abstraction in Libprocess
* [MESOS-3719] - Core dump on /teardown
* [MESOS-3725] - shared library loading depends on environment variable updates
* [MESOS-3833] - /help endpoints do not work for nested paths
* [MESOS-3940] - /reserve and /unreserve should be permissive under a master without authentication.
* [MESOS-4029] - ContentType/SchedulerTest is flaky.
* [MESOS-4047] - MemoryPressureMesosTest.CGROUPS_ROOT_SlaveRecovery is flaky
* [MESOS-4071] - Master crash during framework teardown ( Check failed: total.resources.contains(slaveId))
* [MESOS-4249] - Mesos fetcher step skipped with MESOS_DOCKER_MESOS_IMAGE flag
* [MESOS-4255] - Add mechanism for testing recovery of HTTP based executors
* [MESOS-4285] - Mesos command task doesn't support volumes with image
* [MESOS-4291] - fs::enter(rootfs) does not work if 'rootfs' is read only.
* [MESOS-4298] - Sync up configuration.md and flags.cpp
* [MESOS-4338] - Create utilities for common shell commands used.
* [MESOS-4370] - NetworkSettings.IPAddress field is deprecated in Docker
* [MESOS-4383] - Support docker runtime configuration env var from image.
* [MESOS-4395] - Add persistent volume endpoint tests with no principal
* [MESOS-4416] - Get the perf version function return fail
* [MESOS-4427] - Ensure ip_address in state.json (from NetworkInfo) is valid
* [MESOS-4454] - Create common sha512 compute utility function.
* [MESOS-4478] - ReviewBot seemed to be crashing ReviewBoard server when posting large reviews
* [MESOS-4484] - GMock warning in MasterTest.OrphanTasks
* [MESOS-4495] - Delete `os::chown` on Windows
* [MESOS-4496] - Replace `glob` on Windows with something more suited to the platform
* [MESOS-4499] - Docker provisioner store should reuse existing layers in the cache.
* [MESOS-4517] - Introduce docker runtime isolator.
* [MESOS-4542] - MasterQuotaTest.AvailableResourcesAfterRescinding is flaky.
* [MESOS-4546] - Mesos Agents needs to re-resolve hosts in zk string on leader change / failure to connect
* [MESOS-4555] - Build broken with GCC 5.3.0
* [MESOS-4556] - ShasumTest.SHA512SimpleFile failed on centos7.