Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Deep dive with Mesos and persistent storage for applications #14

Closed
clintkitson opened this issue Mar 7, 2016 · 7 comments
Closed

Deep dive with Mesos and persistent storage for applications #14

clintkitson opened this issue Mar 7, 2016 · 7 comments
Assignees
@dvonthenen
Labels
Code for IT Complete Persistent Applications with Containers Session Status/Green
Milestone
Complete

Comments

@clintkitson
Copy link
Member

Persistent applications that can be complex to operate and scale tend to be perfect for Apache Mesos. Internal direct attached storage and external storage are both options to run your applications. This talk will outline patterns for using these to allow deployment of managed frameworks and tasks, while maintaining fault tolerance and scalability.
@dvonthenen
Copy link
Member

Deep Dive with Mesos and Persistent Storage for Applications

  • Introduction
    • Presenter
    • Agenda
  • Quick Review of Mesos
    • Describe Mesos
      • Singly managed resource pool
      • Scheduler/Dispatcher of Applications
    • Mesos
      • Master Nodes (Zookeeper Quorum)
      • Agent (Slave) Nodes
    • Application Support
      • Generic
      • Framework
    • Application Examples
  • Frameworks and Two Layer Scheduling
    • What is a Framework?
      • Schedulers
      • Executors
    • Framework Architecture
      • What are the moving parts?
    • Who is talking to who? (Interaction Diagram)
    • What does a Framework buy me?
      • Two Layer Scheduling
    • Use cases from other popular frameworks
      • GPU
      • Disperse application deployment
      • Etc
    • Framework Examples
  • Production Applications
    • Using Containers for Apps
    • Containers Stateless
      • Applications need state somewhere!
      • Example applications needing state
    • Applications without state?
      • Hmmmm...
    • How to get state?
      • Mesos... local disk
      • Docker... local disk
      • Better way?
    • Persistent External Storage
      • mesos-module-dvdi
      • REX-Ray
  • Demo
    • Configuration Description of Demo (AWS)
    • Demo 1: Production Website
      • Start Deploy and Describe Setup (MVC)
        • UI (Golang)
        • Business Logic - REST API (Golang)
        • Postgres (Model)
      • Disaster!
        • Node Failure
        • Disk Failure
        • Downtime (or performance hit) to RAID rebuild
        • Network failure or partitioning event!
      • Answer: External Storage!
    • Demo 2: Elastic Search Framework using External Storage
      • Start Deploy and Describe Setup
        • Elastic Search Mesos Framework
        • 3 Node Elastic Search Cluster
      • Disaster!
      • Answer: External Storage!
        • Node recovers from where it left off (quicker recovery)
        • No node rebuild (hardware rebuild fast, software slow)
  • Conclusions

@dvonthenen dvonthenen added this to the Outline milestone Mar 14, 2016
@clintkitson clintkitson modified the milestones: Outline, Draft Mar 18, 2016
@clintkitson clintkitson reopened this Mar 18, 2016
@clintkitson
Copy link
Member Author

Demo idea #31

@clintkitson
Copy link
Member Author

Demo idea #33

@clintkitson
Copy link
Member Author

Demo idea #37

@dvonthenen
Copy link
Member

https://www.emcworldonline.com/2016/connect/sessionDetail.ww?SESSION_ID=2720

@dvonthenen
Copy link
Member

Submitted to EMC {code} Google Drive:
code.14 Deep Dive with Mesos and Persistent Storage for Applications.pptx

@clintkitson clintkitson modified the milestones: Draft, Complete Apr 14, 2016
@clintkitson clintkitson reopened this Apr 14, 2016
@clintkitson clintkitson modified the milestone: Complete Apr 14, 2016
@dvonthenen
Copy link
Member

Final version is located on the {code} google drive.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@dvonthenen dvonthenen

Labels
Code for IT Complete Persistent Applications with Containers Session Status/Green
Projects
None yet
Milestone
Complete
Development

No branches or pull requests
2 participants
@clintkitson @dvonthenen