Skip to content

Latest commit

 

History

History
1258 lines (1118 loc) · 43.8 KB

Edge-SIG-Weekly-Meeting-Notes.md

File metadata and controls

1258 lines (1118 loc) · 43.8 KB

Centaurus - Edge + SIG Weekly Meeting

  • Wednesday 3:00 - 4:00 PM
  • ZOOM

02/17

Agenda:

Notes:

  • Global scheduling vs Edge scheduling & placement
    • Scheduling algorithm
  • Collect list of ideas for discussion
  • Schedule a meet about PolarisCloud
  • Edge models : KubeEdge vs Light mode KubeEdge vs K3s
  • Security vs latency, websocket or better options.
  • Scale up from 2,3k
  • KubeFlow & https://github.com/kubeflow/kfserving

02/24

Agenda

  • Edge solution survey (tracking by pdgetrf/ArktosEdge#9)

    • Single node edge
    • Autonomous cluster at Edge (see slides)
    • Features
      • cloud <-> edge tunnel/proxy
      • edge anomomy
        • edge-side apiserver/caching layer
        • edge node and npod health check / stay alive
        • resource grouping (node group, cluster group, deploymet/service group)
      • edge cluster
        • deployment and management
        • self-managing cluster, master migration on power loss

  • Other tracking topics

    • KubeEdge MEC Architectur (Mizar into EdgeMesh, gateway, Edge-edge comm, Deepak 3/3 talk)
    • RAINBOW Fog-aware Scheduler

  • New Finds

Notes

  • lite edge vs full fledged

03/03

Agenda

  • EdgeCluster feature
    • Edge capability: survive both network and node failure
    • Locality is important
    • Self-managing cluster
    • EdgeCluster as a custom resource

03/10

Agenda

  • n-ary tree based Arktos Edge topology

Notes

  • complexity worth it?
  • local firewall preventing clusters to connect to their root clusers
  • local node vs gloal management
  • multi-tenancy at edge node (in recursive case, there's a conflict case to discuss)
  • use case scenario for hireachy structure
    • kube MEC meeting
  • centralized controls over de-centralized control
  • schedule meeting with Deepak about network and security

03/18

Agenda

  • hireachy model & use cases
  • cluster connector demo
  • multi-tenancy EdgeCluster
  • EdgeCluster provisioning model
  • EdgeCluster components initial thoughts (cut short due to time limit)

Notes

  • EdgeCluster as first release goal
  • VPC in EdgeCluster needs further looked into

03/24

Agenda

Notes

argument between all resource connecting to cloud vs local inter-connected edge cluster

03/31

Agenda

  • 4/27 interval SIG review
  • New KubeCon NA CFP deadline: 5/23
  • Feature Scoping summary
  • Settle the debate from last meeting (by showing them under a single framework)
  • AWS Outputs/Local Zones/Wavelength (and assumption of how they work)

Notes

  • SOW plan (in a week or two)
  • Release in 5/30 or 6/30

4/7

Agenda

  • POC design and progress
    • KubeEdge
    • OpenYurt
  • KubeEdge MEC planning

Notes

4/14

Agenda

  • Community meeting
  • POC design and progress
    • KubeEdge
    • OpenYurt (in details by Qian)
  • KubeEdge MEC topics

Notes

  • POC
  • Vision doc

4/21

Agenda

  • Design Communication
    • Team demo by Qian
    • Discussion with Liguang
    • TSC meeting on 27th (what to bring?)
  • POC
    • Dev env setup
    • Merge KubeEdge with Arktos
    • Add edge cluster support
      • Top down route: Add CRDs to cluster
      • Bottown up route: Extend edged to accept and forward mission (workload) request to Arktos
  • KubeEdge community meeting study
    • Edge cluster
    • AKE (support kubectl on edge node)
  • Inter-edgecluster communication
  • VR MEC demo by AWS Wavelength
  • KubeEdge MEC topics

Notes

  1. inter-EdgeCluster
  2. SOW draft
  3. Schedule meeting to sync with KubeEdge meeting
  4. 07/31 first release, 05/31 design deadline

4/28

Agenda

  • Overall progress review
  • POC progress update
  • Global Scheduling project handoff

5/5

Agenda

  • Overall progress review

  • Global Scheduling project handoff

  • POC progress update

    • cascading cluster demo by Qian
      • client-go vs kubectl
    • Status reporting POC plan

  • SOW ideas

    • client-go
    • cluster/workload status update

  • Global scheduling for the Edge

  • MEC status

  • Meeting consolidation

    • Monday night: Global Scheduler
    • Monday & Wednesday: Edge scrum
    • Tuesday night: Arktos community
    • Wednesday afternoon: Edge SIG
    • Thursday night: KubeEdge, KubeEdge MEC

5/12

Agenda

  • Overall progress review
  • Global Scheduler project
  • POC focus
    • Edge cluster status
    • inter Edge cluster comm
    • Self-organizing cluster
    • Scheduler enhancement
  • Edge cluster status update design
  • MEC

Note

  • Deployment vs Mission
  • Status needs to be stored on top layers
  • First release scope (2 layers)
  • Cluster status in 2nd release
  • Workload status in 1st release. Periodic update first.

5/19

Agenda

  • Overall progress review
  • POC
    • Cascading cluster
    • Edge cluster status
    • inter Edge cluster comm
    • Edge core refactor into edge agent (working with KubeEdge)
    • Self-organizing cluster
    • Scheduler enhancement
  • Demo & Perf
    • Edge application to showcase POC
  • Publication
    • KubeCon (due by 5/23)
    • Open Networking & Edge Summit + Kubernetes on Edge Day (Due by 6/20)
    • Community White paper
  • MEC

Note

5/26

Agenda

  • Overall progress review
  • POC
    • Cascading cluster
    • Edge cluster status
    • inter Edge cluster comm
    • Edge core refactor into edge agent (working with KubeEdge)
    • Self-organizing cluster
    • Scheduler enhancement
  • Demo & Perf
    • Edge application to showcase POC
  • Publication
    • KubeCon (due by 5/23)
    • Open Networking & Edge Summit + Kubernetes on Edge Day (Due by 6/20)

Note

6/2

Agenda

  • Edge Status
    • Cascading cluster
    • Edge cluster status
    • inter Edge cluster comm (Qian, Shaojun)
      • Mizar setup
      • Zeta
      • libp2p
      • Application load balancer
    • Self-organizing cluster (Eunju)
    • Env setup doc, repository, CICD, etc.
    • Slack edge-dev channel
    • Edge core refactor into edge agent (working with KubeEdge)
    • Scheduler enhancement
  • Publication
    • KubeCon (due by 5/23)
    • Open Networking & Edge Summit + Kubernetes on Edge Day (Due by 6/20)
    • Design doc (due by 6/4, Peng & Qian)
  • Demo & Perf
    • Edge application to showcase POC
  • MEC
    • Dev & Release plan
      • Akrano demo 8/26

6/9

Agenda

  • Status
    • Design doc
    • Deadlines:
    • 7/30-> 8/30 Release Planning
      • Items:
        • Edge Cluster
        • Cascading Clusters
        • Inter-cluster Communication
      • Repo
      • Feature gap sync with Akraino release/demo
      • UWB edge use case, legal assurence
    • MEC
  • POC
    • Inter-cluster Communication

Note

  • Alcor CNI not compatible?
  • Inter-cluster communication scope:
    • Scoped:
      • pods that belong to the same VPC but in different physical clusters to talk to each other
      • pods that belong to different VPCs in different physical clusters to talk to each other
    • Non-scoped:
      • pods that belong to different VPCs in the same physical cluster to talk to each other (Mizar)

6/16

Agenda

Notes

6/23

Agenda

  • Open Source Summit proposal
  • ONE deadline 6/20, ICC scope
  • POC
    • Inter-cluster Communication
      • package paths
      • control plane management
      • Mizar requirement one-pager
  • Next monday community meeting
    • libp2p talk
    • UWB use case walk through

Notes

6/30

Agenda

  • Inter-cluster Communication
    • Status
      • Overall design being finalized
        • Design doc
          • Scope
          • Data flow
          • Control flow
      • POC Risk: data flow
        • Connectivity
        • Performance
    • POC
      • Data flow
        • Divider redirect, possibly as a Mizar feature in future release
        • Gateway packet packing and transfering
      • Control flow
        • VPC & subnet creation top-down through Mission
        • VPC & subnet global update as a distributed map (slides)
      • Mizar requirement one-pager
        • Mizar's pod integration with VPC and subnet
        • network control plane
        • Configurable divider for XDP_REDIRECT
      • P2P solution survey by Eunju
  • External collab
    • libp2p talk
    • UWB use case to be presented in a few weeks

7/7

Agenda

  • Inter-cluster Communication

    • Status
      • Overall design being finalized
      • POC Risk: data plane flow
        • tasks
        • Targeting mid-July
        • Daily scrum
        • Need tech support from Mizar team on env setup and debugging
    • POC
      • Data flow
        • Divider redirect, possibly as a Mizar feature in future release
        • Gateway packet packing and transfering
      • Control flow
        • VPC & subnet global synchronization (slides)
      • Mizar requirement one-pager
        • Mizar's pod integration with VPC and subnet
        • Network control plane
        • Configurable divider for XDP_REDIRECT

  • New Finds

Notes

7/14

Agenda

  • Inter-cluster Communication

    • Status
      • Overall design being finalized
      • POC Risk: data plane flow
        • tasks
        • Targeting mid-July
    • POC

      • Goal:

        • Redirect packet to gateway process
        • Unblock gateway development

      • Mizar deeper dive and possible routes

        • "1 program and 3 maps"
        • Possible routes for packet redirect at divider
          • Inject gateway ip into the "network map" directly on host
          • Modify operator to inject gateway ip (possible here) (owner: Shaojun)
          • Modify existing subnet0's endpoint value to point to gateway ip (note: currently default subnet0 consumes the entire CIDR space of vpc0, so the goal here is to simply divert packet traffic on divider to external gateway so gateway work can be unblocked) (owner: Qian)
          • Modify transit XDP to redirect (release solution (possibly here)

  • Collaboration

    • UWB edge requirement disucssion on 15th

Notes

7/21

Agenda

  • Overall status
    • OSS not accepted :(
      • Priority:
    design --> release -> perf test 
                  |
                  +-> academia conferences -> exposure conferences

  • Project tracked in two fronts:

    • Release
      • Repo & CICD (owner: Qian)
      • Edge Cluster featrues (owner: Qian)
    • POC: Inter-cluster communication

  • Inter-cluster Communication status

    • POC Risk: data plane flow
      • tasks
      • Targeting mid-July
    • POC
      • Goal:
        • Redirect packet to gateway process
        • Unblock gateway development
      • More Mizar deep dive and possible routes
        • Possible routes for packet redirect at divider
          • [ ] Inject gateway ip into the "network map" directly on host
          • Modify operator to inject gateway ip (possible here) (owner: Shaojun)
          • [ ] Modify existing subnet0's endpoint value to point to gateway ip (note: currently default subnet0 consumes the entire CIDR space of vpc0, so the goal here is to simply divert packet traffic on divider to external gateway so gateway work can be unblocked)
        • Release solution
          • Modify transit XDP to redirect (release solution (possibly here)
          • Mizar control plane update the network map based on gateway's map

  • Collaboration

    • UWB to present next week

8/3

Agenda

  • Priority
    design --> release -> perf test 
                  |
                  +-> academia conferences -> exposure conferences

8/11

Agenda

  • Overall status

    • Project tracks:
      • Release
        • Release Plan
        • Edge cluster featrues (owner: Qian)
          • Detailed test plan
            • Manual at the moment, automated after 8/30 release
            • ~20 key scenarios (more to come)
          • Edge application on hierarchical clusters
            • Goal: demo the benefits of hierarchical edge clusters
            • Latency
            • Autonomy
            • Distributed cloud (offload cloud application to the edge, together with dependencies)
            • 5G (network speed > local disk I/O --> short video encoding/decoding, gaming)
        • Inter-cluster communication 8/30
          • release components: Gateway
            1. Design doc + E2E POC Demo
            2. Initial version of the Gateway, tested against Mizar's Kind env + Edge cluster release env
      • POC: Inter-cluster communication
        • Goal:
          • Pod traffic e2e
          • Detailed gateway design
        • Tech discussion
          • Multi-cluster VPC/Subnet
          • VNI translation between different clusters
          • Direct-path

  • Akraino Release (8/26)

8/18

Agenda

  • Overall status

    • Project tracks:
      • Release
        • Release Plan
        • Edge cluster featrues (owner: Qian)
          • (Merged) Detailed test plan
          • Edge application on hierarchical clusters (owner: Qian)
            • Goal: demo the benefits of hierarchical edge clusters
            • Benchmark
            • CDN
        • Inter-cluster communication 8/30
          • Release components: Gateway
            1. Design doc + E2E POC Demo
            2. Initial version of the Gateway, tested against Mizar's Kind env + Edge cluster release env
          • POC
            • Goal:
              • Pod traffic e2e
              • Detailed gateway design
            • Tech discussion
              • Direct-path across clusters
    • Exposures

  • Akraino Release (8/26)

8/25

Agenda

  • Overall status

    • Project tracks:
      • Release
        • Adjustment
          • 830 release with edge cluster
            • Cut release branch on 8/31 (next Wednesday)
          • inter-cluster communication to be released in 930 (together with any edge cluster fixes)
        • Edge application on hierarchical clusters (owner: Qian)
          • Goal: demo the benefits of hierarchical edge clusters
          • Idea 1: Edge Benchmark
            • Represents a class of applications that fit a certain profile. In terms of edge,
              • Latency & data locality
                • Large data volume on the edge
                • Data has regional features
              • Local vs global processing
                • Edge (Local) processing + global aggregation
              • Autonomous against resource event
                • Network failure
                • Node failure
              • Remote management
                • Deploy and manage from upper level
          • Idea 2: Real-world application
          • 9/27 OSS edge talk with link to demo video
        • Inter-cluster communication 9/30
          • POD VPC PR from Phu
          • Switching from Kind env to K8s/Arktos env
          • POC
            • Goal:
              • Pod traffic e2e
              • Detailed gateway design
    • Exposures

  • Akraino Release

9/1

Agenda

  • Overall status
    • Project tracks:
      • Release
        • 830 release
        • Edge application on hierarchical clusters (owner: Qian)
          • Goal: demo the benefits of hierarchical edge clusters
            • AI application demo (by Qian)
            • Benchmarking
            • 9/27 OSS edge talk with link to demo video (todo)
            • Serverless
        • Inter-cluster communication 9/30
          • Switching from Kind env to real K8s cluster env (owner: Peng)
            • Env setup
            • Documentation
          • POC
            • Goal:
              • Pod traffic e2e
              • Detailed gateway design
        • New release brainstorming
          • 5G application
    • Exposures
  • Akraino Release
    • On track

9/8

Agenda

  • Overall status
    • Project tracks:
      • Release
        • 830 release
        • 930 release "Inter-cluster communication"
          • Edge Cluster Mission Improvement inspired by AI demo experience (owner: Qian)
            • Goal: to allow deployment of AI demo completely with Mission from cloud to edge
          • Switching from Kind env to real K8s cluster env (owner: Peng)
          • POC
            • Goals (targeting mid Sept)
              • Pod traffic e2e (to use proxy as gateway)
              • Detailed gateway design
          • Release item (some risk due to team size change, to be further estimated by end of this week)
            • Gateway
        • New release brainstorming (next week after 15th)
    • Exposures
      • Friday brown bag talk, video
      • Kubecon Publication, topic "Edge Networking with Mizar", 600-1000 words, due by 9/10 (owner Peng)
      • Peer-reviewed Academic Conferences
        • CFP
          • NSDI
            • Paper titles and abstracts due: 9/9
            • full paper 9/15
  • "Macro trend" discussion (due by 10/31)
    • 5G application
    • Cloud-cloud vs Cloud-edge
  • Akraino Release
    • On track

9/15

Agenda

  • Overall status
    • Project tracks:
      • Release
        • 830 release
        • 930 release "Inter-cluster communication"
          • Edge Cluster Mission Improvement inspired by AI demo experience (owner: Qian)
          • POC
            • Goals (targeting mid Sept)
              • Pod traffic e2e (to use proxy as gateway)
              • Detailed gateway design
          • Release item (to be further estimated by end of this week)
        • New release brainstorming (next week after 15th)
    • Exposures
      • Kubecon Publication
      • Peer-reviewed Academic Conferences
        • CFP
          • NSDI, will aim for their next April deadline due to team size change
  • "Macro trend" discussion (due by 10/31)
    • 5G application
    • Cloud-cloud vs Cloud-edge
  • Akraino Release
    • On track (documentation owner?)

9/21

Agenda

  • Overall status
    • Project tracks:
      • Release
        • 930 release "Inter-cluster communication"
          • Edge Cluster Mission Improvement inspired by AI demo experience (owner: Qian)
            • "One-click" edge app deployment
            • Front-end needs more work for a better live demo
            • Team demo
          • Edge-edge communication
            • Automated dev env setup for Qian and David
            • POC/Dev
              • Pod traffic e2e (to use proxy as gateway) (70%)
                • Mizar control plane changes for gateway host
                • Mizar data plane to
                  1. route traffic to user space on gateway host
                  2. avoid ep_host_cache on divider when traffic comes from the gateway host
                • connect 2nd cluster and perform e2e test
              • Detailed gateway design
          • Release items
        • New release brainstorming (next week after 27th)
    • Exposures
  • "Macro trend" discussion (due by 10/31)
    • 5G application
    • Cloud-cloud vs Cloud-edge
    • Paper reading
      • Deep Learning With Edge Computing- A Review
      • Adaptive Federated Learning in Resource Constrained Edge Computing Systems
      • Edge Intelligence- Paving the Last Mile of Artificial Intelligence With Edge Computing
      • The Emerging Landscape of Edge-Computing
  • Akraino Release
    • documentation owner settled

9/29

Agenda

  • Overall status
    • Project tracks:
      • Release
        • 930 release "Inter-cluster communication"
          • Edge-edge communication
            • Automated dev env setup for Qian and David
            • POC/Dev
              • Pod traffic e2e (to use proxy as gateway) (70%)
                • Mizar control plane changes for gateway host
                • Mizar data plane to
                  1. route traffic to user space on gateway host
                  2. avoid ep_host_cache on divider when traffic comes from the gateway host
                • connect 2nd cluster and perform e2e test
              • Detailed gateway design, 930 release
        • New release brainstorming (next week after 27th)
    • Exposures
      • OSS tutorial talk 9/27
  • "Macro trend" discussion (due by 10/31)
    • 5G application
    • Cloud-cloud vs Cloud-edge
    • Serverless
    • Paper reading
      • Deep Learning With Edge Computing- A Review
      • Adaptive Federated Learning in Resource Constrained Edge Computing Systems
      • Edge Intelligence- Paving the Last Mile of Artificial Intelligence With Edge Computing
      • The Emerging Landscape of Edge-Computing
  • Onboarding
  • Akraino Release
    • documentation owner settled
  • Notes:

10/06

Agenda

  • Overall status
    • Project tracks:
      • Release
        • 930 release
          • Edge-edge communication
        • New release brainstorming (next week)
    • Exposures
      • KubeCon virtual booth slides tutorial talk 9/27
  • "Macro trend" discussion (due by 10/31)
    • 5G application
    • Cloud-cloud vs Cloud-edge
    • Serverless
    • Edge gallery for 5G MEC
    • Paper reading
      • Deep Learning With Edge Computing- A Review
      • Adaptive Federated Learning in Resource Constrained Edge Computing Systems
      • Edge Intelligence- Paving the Last Mile of Artificial Intelligence With Edge Computing
      • The Emerging Landscape of Edge-Computing
  • Onboarding
  • Akraino Release
    • documentation owner settled

10/20

Agenda

  • Overall status
    • Project tracks:
      • edge-edge communication XDP direct ping succeeded
      • myth of direct path resolved
      • "Edge Gateway" -> "Edge Portal"
    • New release planning
      • Recent conference sync-ups (ONE, KubeCon)
      • Edge network provisioning (deployment+)
      • Edge service discovery (pod migration, edge portal system control plane)
      • Exteand the AI face recognition program to multiple-cluster
      • Federated learning showcase
      • Edge benchmarking
  • "Macro trend" discussion (due by 10/31)
    • 5G application
    • Cloud-cloud vs Cloud-edge
    • Serverless
    • Edge gallery for 5G MEC
    • Paper reading
      • Deep Learning With Edge Computing- A Review
      • Adaptive Federated Learning in Resource Constrained Edge Computing Systems
      • Edge Intelligence- Paving the Last Mile of Artificial Intelligence With Edge Computing
      • The Emerging Landscape of Edge-Computing
  • Akraino Release
    • log uploads?

notes

  • Serverless on the edge
  • Distributed storage (distributed data bus across edge) "Ceph across edge", on top of edge-edge

10/27

Agenda

  • Overall status

    • Project tracks:
      • Qian:
      • Shaojun: Control plane changes (POC code -> release code)
      • David: Testing, dev environment to catch up Mizar newest release)
      • Peng:
        • Roadmap & landscape planning
        • Edge gateway initial release design
        • team support

  • "Macro trend" & Roadmap

    • Fornax goals review (slides)
    • Field scoping
      • Existing & Promising Solution
      • Academia Papers
        • The Emerging Landscape of Edge-Computing
        • Edge Intelligence- Paving the Last Mile of Artificial Intelligence With Edge Computing (60%)
        • Adaptive Federated Learning in Resource Constrained Edge Computing Systems
        • Deep Learning With Edge Computing- A Review
      • Industry Conferences
        • "Global edge computing conference"
          • Short term vs long term
      • 5G & MEC

  • Akraino Release

    • log issue fix

  • 2nd brown bag

    • Communication & presentation

11/10

Agenda

  • Overall status
    • Release 1/30 items
      • Edge-edge communication
        • VPC, subnet deployment through edge clusters
        • Service/scaled endpoint based edge networking (POC)
      • Edge storage & serverless scoping and initial design
      • Edge scheduler scoping
    • Team allocation:
      • Qian:
        • Edge communication agent
        • Knowledge transfer
          • Edge clusters
          • Edge AI application
          • Edge agent
      • Shaojun:
        • Control plane changes
        • Data plane changes
      • David:
        • Testing, dev environment to catch up Mizar newest release
        • Knowledge transfer : Edge clusters
      • Peng:
        • Roadmap & landscape planning
        • Edge gateway initial release design
        • team support
      • Edge agent demo
  • "Macro trend" & Roadmap
    • Fornax goals
    • Field scoping
      • Key directions:
        • Scheduling: Sina & global scheduler
        • Edge storage
        • Serverless
        • Existing & Promising Solution
      • Academia papers
        • The Emerging Landscape of Edge-Computing
        • Edge Intelligence- Paving the Last Mile of Artificial Intelligence With Edge Computing (60%)
        • Adaptive Federated Learning in Resource Constrained Edge Computing Systems
        • Deep Learning With Edge Computing- A Review
      • Industry conferences submission
        • Deadlines for academia conference in 2022
          • Topics:
            • Edge cluster
            • Edge communication
            • Performance & utilities evaluation
  • Akraino Release
  • Talk and outreach
    • 2nd brown bag: Communication & Presentation
    • Information sharing: Mizar tooling for the Arktos team
    • Community: UW Bothell CSS talks on our edge, possible project cooperation with grad students. Internship opportunities too.

11/17

Agenda

  • Centaurus edge factors
    • Infra Framework
    • Flexibility
    • Scalability
    • Resilence
    • Usability
      • For end users
      • For developers
  • Overall status
    • Release 1/30 items, see project
      • Edge communication (pod to pod, pod to service)
      • Serverless in a hierarchical edge environment POC
        • stateful: Edge KV store POC
        • runtime support (WebAssembly, etc.)
      • AI face recognization app on hierarchical edge clusters
        • spearate frontend with backend
        • backend "smart" scaling
    • Team allocation:
      • Shaojun:
        • Control plane changes
        • Data plane changes
        • Scaled ep for edge (to sync up with Edge team, slides for scenarios)
        • edge gateway agent (together with Peng)
      • David:
        • Edge cluster setup documentation and automation
      • Peng:
        • Roadmap & feature scoping
        • Edge gateway agent POC -> release
      • Edge agent demo
  • Scoping & Roadmap
    • Field scoping
      • Key directions:
        • Scheduling:
        • Edge storage (KV store)
        • Serverless
          • Overview presentation next Tuesday, need to sync up with other participants' @Mengni
          • Previous design by Casey
          • Edge Scheduling
          • New Runtime: WebAssembly
      • Academia papers image
      • Industry conferences submission
        • Deadlines for academia conference in 2022
          • Topics:
            • Edge cluster
            • Edge communication
            • Performance & utilities evaluation
  • Akraino Release
  • Talk and outreach
    • 2nd brown bag: Communication & Presentation
    • Information sharing: Mizar tooling for the Arktos team
    • Community: UW Bothell CSS talks on our edge, possible project cooperation with grad students. Internship opportunities too.

Notes

  • Manage cluster management at the infra level (),
  • Security as a goal
  • serverless design

11/24

Agenda

  • Overall status
    • Release 1/30 items, see project
      • Edge communication
        • pod to pod
        • pod to service has feature gap from Mizar
      • Stateful Serverless
        • stateful: Edge KV store POC
        • runtime support (WebAssembly, etc.)
      • AI face recognization app on hierarchical edge clusters
        • convert to serverless
        • spearate frontend with backend
        • backend "smart" scaling
    • Team allocation:
      • Shaojun:
        • Control plane changes
        • Data plane changes
        • Scaled ep for edge (to sync up with Edge team, slides for scenarios)
        • edge gateway agent (together with Peng)
      • David:
        • Edge cluster setup documentation
        • Edge cluster setup automation
      • Peng:
        • Stateful serverless
          • Stateful serverless on edge talk
          • Basic serverless usage (Kubeless)
          • Edge storage options try out
          • Webassembly deeper dive
        • Edge gateway agent design
      • Edge agent demo
  • Scoping & Roadmap
    • Industry conferences submission
      • Deadlines for academia conference in 2022
        • Topics:
          • Edge cluster
          • Edge-edge communication
          • Performance & utilities evaluation
  • Akraino Release
  • Talk and outreach
    • More video & streaming use cases and concrete scenarios
    • 2nd brown bag: Communication & Presentation
    • Information sharing: Mizar tooling for the Arktos team
    • Community: UW Bothell CSS talks on our edge, possible project cooperation with grad students. Internship opportunities too.

12/01

Agenda

  • Overall status
    • Release 1/30 items, see project
      • Edge communication
        • pod to pod
        • pod to service has feature gap from Mizar
      • Stateful Serverless
        • stateful: Edge KV store POC
        • runtime support (WebAssembly, etc.)
      • AI face recognization app on hierarchical edge clusters
        • convert to serverless
        • spearate frontend with backend
        • backend "smart" scaling
    • Team allocation:
      • Shaojun:
        • Control plane changes
        • Data plane changes
        • Scaled ep for edge (to sync up with Edge team, slides for scenarios)
        • Sync up edge gateway with the latest Mizar release (v0.9)
      • David:
        • Edge cluster setup documentation
        • Edge cluster setup automation
      • Peng:
        • Edge gateway agent design
        • Stateful serverless
          • Stateful serverless on edge talk
          • Edge serverless framework try out
            • Kubeless
            • Knative
          • Edge serverless runtime try out
            • WASMEdge
          • Edge KV storage try out
            • Anna
            • annabellaDB
            • OrbitDb
          • Edge KV storage possible directions
            • CRDT based distributed KV store
              • Pros & cons
            • "access-pattern aware key-value store"
            • Move data vs Move computation (regional scheduling)
            • Horizontal regional "spill-out" scheduling
      • Edge agent demo
  • Scoping & Roadmap
    • Industry conferences submission
      • Deadlines for academia conference in 2022
        • Topics:
          • Edge cluster
          • Edge-edge communication
          • Performance & utilities evaluation
  • Akraino Release
  • Talk and outreach
    • 2nd brown bag: Communication & Presentation
    • Information sharing: Mizar tooling for the Arktos team
    • Community:
      • UW Bothell professor to give a talk on their use cases (in 2 weeks) and possible project cooperation with grad students

12/09

Agenda

  • WasmEdge discussion
    • Questions in mind
      • Usage, compatibility
      • Performance
      • Limitation (comparing to container based FAAS)
  • Project Tracking
    • Release 1/30 items, see project
      • Edge communication
        • pod to pod communication (30%)
      • Stateful Serverless
        • stateful: Edge KV store POC (60%)
        • runtime support (WebAssembly, etc.) (70%)
      • AI face recognization app on hierarchical edge clusters (stretch goal, not started yet)
        • convert to serverless
        • spearate frontend with backend
        • backend "smart" scaling
    • Team allocation:
      • Shaojun:
        • Control plane changes
        • Data plane changes
        • Scaled ep for edge (scraped for 1/30 release)
        • Sync up edge gateway with the latest Mizar release (v0.9)
        • Merge perviously POC control plane code into Mizar
      • David:
        • Edge cluster setup documentation
        • K3s in edge clusters
      • Ke:
        • Research on CDN serversless solutions
          • To presentation at future community meeting (time TBD)
      • Peng:
        • Edge gateway agent design
        • CRDT DB for the edge
        • Stateful serverless
          • Stateful serverless on edge talk
          • Edge serverless framework try out
            • Kubeless
          • Edge serverless runtime try out
            • WASMEdge
          • Edge KV storage try out
            • Anna
            • annabellaDB
            • OrbitDb
          • Edge KV storage possible directions
            • CRDT & consistency fundamentals
            • CRDT based distributed KV store
            • Move data vs Move computation (regional scheduling)
            • Cross-cluster storage
            • Cross-cluster scheduling
            • Region-aware horizontal scheduling
  • Scoping & Roadmap
    • Industry conferences submission
      • Deadlines for academia conference in 2022
        • Topics:
          • Edge cluster
          • Edge-edge communication
          • Performance & utilities evaluation
  • Akraino Release
  • Talk and outreach
    • 2nd brown bag: CRDT for A Stateful Edge (Theory, practice, edge use cases) ~ within 2 weeks
    • 3rd brown bag: [Communication & Presentation]
    • Community:
      • UW Bothell professor to give a talk on their use cases (in 2 weeks) and possible project cooperation with grad students

12/15

Agenda

  • Project Tracking
    • Release 1/30 items, see project
      • Edge communication
        • pod to pod communication (40%)
      • Stateful Serverless
        • stateful: Edge KV store POC (60%)
        • runtime support (WebAssembly, etc.) (70%)
    • Team allocation:
      • Shaojun:
        • edge communication release code
          • Control plane changes
          • Data plane changes
          • Scaled ep for edge (scraped for 1/30 release)
          • Sync up edge gateway with the latest Mizar release (v0.9)
          • Merge perviously POC control plane code into Mizar
      • David:
        • Edge cluster setup documentation
        • K3s in edge clusters
      • Ke:
        • Research on CDN serversless solutions
          • Blog post in writing
          • To presentation at future community meeting (time TBD)
      • Qingming:
        • CRDT based distributed storage Anna
      • Peng:
        • Edge gateway agent release code (highest priority)
          • XDP changes & e2e flow
        • Stateful serverless
          • Stateful serverless on edge talk
          • Edge serverless framework try out
            • Kubeless
          • Edge serverless runtime try out
            • WASMEdge
          • Edge KV storage try out
            • Anna
            • OrbitDb
          • Edge KV storage possible directions
            • CRDT & consistency fundamentals
            • CRDT based distributed KV store
            • Move data vs Move computation (regional scheduling)
            • Cross-cluster storage
            • Cross-cluster scheduling
  • Scoping & Roadmap
    • Industry conferences submission
      • Deadlines for academia conference in 2022
        • Topics:
          • Edge cluster
          • Edge-edge communication
          • Performance & utilities evaluation
  • Akraino Release
  • Talk and outreach
    • 2nd brown bag: CRDT for A Stateful Edge (Theory, practice, edge use cases) ~ within 2 weeks
    • 3rd brown bag: [Communication & Presentation]
    • Community:
      • UW Bothell professor to give a talk on their use cases (in 2 weeks) and possible project cooperation with grad students