CRIU - User contributions [en]

https://criu.org/api.php?action=feedcontributions&feedformat=atom&user=Wenhuizhang CRIU - User contributions [en] 2026-05-13T16:33:55Z User contributions MediaWiki 1.35.6 https://criu.org/index.php?title=Academic_Research&diff=5575 Academic Research 2024-12-18T02:55:32Z

<p>Wenhuizhang: </p> <hr /> <div>* GPU CRIU<br /> <br /> [SoCC '24] On-demand and Parallel Checkpoint/Restore for GPU Applications<br /> <br /> [EuroSys '24] Just-In-Time Checkpointing: Low Cost Error Recovery from Deep Learning Training Failures<br /> <br /> [arXiv '23] PARALLELGPUOS: A Concurrent OS-level GPU Checkpoint and Restore System using Validated Speculation<br /> <br /> [SC-W '23] Checkpoint/Restart for CUDA Kernels<br /> <br /> [arXiv:2202.07848 '22] Singularity: Planet-Scale, Preemptive and Elastic Scheduling of AI Workloads<br /> <br /> [Wiley '21] Cricket: A virtualization layer for distributed execution of CUDA applications with checkpoint/restart support<br /> <br /> [EuroSys '20] Balancing efficiency and fairness in heterogeneous GPU clusters for deep learning<br /> <br /> [HPEC '20] Using Container Migration for HPC Workloads Resilience<br /> <br /> <br /> <br /> <br /> <br /> <br /> * CRIU for Migration<br /> <br /> [APNet '24] Software-based Live Migration for Containerized RDMA<br /> <br /> [SEATED '24] Live Migration of Multi-Container Kubernetes Pods in Multi-Cluster Serverless Edge Systems<br /> <br /> [ICT '24] Packet Buffering to Minimize Service Downtime and Packet Loss During Redundancy Switchover<br /> <br /> [SIGMOD/PODS '24] Demonstration of ElasticNotebook: Migrating Live Computational Notebook States<br /> <br /> [ICDCS '24] Dapper: A Lightweight and Extensible Framework for Live Program State Rewriting<br /> <br /> [Cloud '24] FastMig: Leveraging FastFreeze to Establish Robust Service Liquidity in Cloud 2.0<br /> <br /> [CCGRID '24] Workload-Aware Live Migratable Cloud Instance Detector<br /> <br /> [VLDB '23] ElasticNotebook: Enabling Live Migration for Computational Notebooks<br /> <br /> [SRDS '23] Transparent Fault Tolerance for Stateful Applications in Kubernetes with Checkpoint/Restore<br /> <br /> [ICFEC '23] Migration of Isolated Application Across Heterogeneous Edge Systems<br /> <br /> [TNSM '23] Design, Modeling, and Implementation of Robust Migration of Stateful Edge Microservices<br /> <br /> [WORDS '23] Evicting for the greater good: The case for Reactive Checkpointing in serverless computing<br /> <br /> [Cloud Summit '23] Microservice Debugging with Checkpoint-Restart<br /> <br /> [ICC '23] Processing-Aware Migration Model for Stateful Edge Microservices<br /> <br /> [DRONES '23] A Dynamic Checkpoint Interval Decision Algorithm for Live Migration-Based Drone-Recovery System<br /> <br /> [arXiv:2301.05861 '23] Async-fork: Mitigating Query Latency Spikes Incurred by the Fork-based Snapshot Mechanism from the OS Level<br /> <br /> [TOCS '22] H-Container: Enabling Heterogeneous-ISA Container Migration in Edge Computing<br /> <br /> [VEE '22] Portkey: hypervisor-assisted container migration in nested cloud environments<br /> <br /> [ICPADS '22] A Container Pre-copy Migration Method Based on Dirty Page Prediction and Compression<br /> <br /> [NetSoft '22] Demonstration of Containerized Central Unit Live Migration in 5G Radio Access Network<br /> <br /> [ATC '22] RRC: Responsive Replicated Containers<br /> <br /> [HAL '22] Good Shepherds Care For Their Cattle: Seamless Pod Migration in Geo-Distributed Kubernetes<br /> <br /> [ATC '21] MigrOS: Transparent Live-Migration Support for Containerised RDMA Applications<br /> <br /> [WoWMoM '21] Extending the QUIC Protocol to Support Live Container Migration at the Edge<br /> <br /> [MobileCloud '20] Docker Container Deployment in Distributed Fog Infrastructures with Checkpoint/Restart<br /> <br /> <br /> <br /> * CRIU Acceleration<br /> <br /> [EuroSys '24] Pronghorn: Effective Checkpoint Orchestration for Serverless Hot-Starts<br /> <br /> [FGCS '24] Prebaking runtime environments to improve the FaaS cold start latency<br /> <br /> [Middleware '23] DynaCut: A Framework for Dynamic and Adaptive Program Customization<br /> <br /> [Virginia Tech '23] CRIU-RTX: Remote Thread eXecution using Checkpoint/Restore in Userspace<br /> <br /> [Virginia Tech '23] HetMigrate: Secure and Efficient Cross-architecture Process Live Migration<br /> <br /> [OSDI '23] No Provisioned Concurrency: Fast RDMA-codesigned Remote Fork for Serverless Computing<br /> <br /> [SC '22] Out of hypervisor (OoH): efficient dirty page tracking in userspace using hardware virtualization features<br /> <br /> [JNCA '22] iContainer: Consecutive checkpointing with rapid resilience for immortal container-based services<br /> <br /> [VLSI '21] Standard-compliant parallel SystemC simulation of loosely-timed transaction level models: From baremetal to Linux-based applications support<br /> <br /> [Middleware '20] Prebaking Functions to Warm the Serverless Cold Start<br /> <br /> [MEMSYS '19] Fast in-memory CRIU for docker containers<br /> <br /> [MCHPC '19] Optimizing Post-Copy Live Migration with System-Level Checkpoint Using Fabric-Attached Memory<br /> <br /> <br /> <br /> <br /> * CRIU Security<br /> <br /> [APSys '24] Towards Efficient End-to-End Encryption for Container Checkpointing Systems<br /> <br /> [eBPF '24] Custom Page Fault Handling With eBPF<br /> <br /> [ARES '24] Don't, Stop, Drop, Pause: Forensics of CONtainer CheckPOINTs (ConPoint)<br /> <br /> [ATC '22] RRC: Responsive Replicated Containers<br /> <br /> [NDSS '22] FitM: Binary-Only Coverage-Guided Fuzzing for Stateful Network Protocols<br /> <br /> [SYSTEX '22] Transparent, Cross-ISA Enclave Offloading<br /> <br /> [IPDPS '20] Fault-Tolerant Containers Using NiLiCon<br /> <br /> <br /> * CRIU for Database<br /> <br /> [Journal of Cloud Computing '24] MDB-KCP: persistence framework of in-memory database with CRIU-based container checkpoint in Kubernetes<br /> <br /> [VLDB '23] Async-fork: Mitigating Query Latency Spikes Incurred by the Fork-based Snapshot Mechanism from the OS Level<br /> <br /> [VLDB '23] ElasticNotebook: Enabling Live Migration for Computational Notebooks<br /> <br /> [arXiv:2301.05861 '23] Async-fork: Mitigating Query Latency Spikes Incurred by the Fork-based Snapshot Mechanism from the OS Level<br /> <br /> [EuroSys '21] On-demand-fork: a microsecond fork for memory-intensive and latency-sensitive applications</div>

Wenhuizhang https://criu.org/index.php?title=Articles&diff=5574 Articles 2024-12-18T02:43:43Z

<p>Wenhuizhang: </p> <hr /> <div><noinclude>This is a collection of external articles regarding the CRIU project, sorted by date.<br /> <br /> </noinclude><br /> * 2024-11-14, [https://dl.acm.org/doi/10.1145/3698038.3698510 On-demand and Parallel Checkpoint/Restore for GPU Applications]<br /> * 2024-09-06, [https://dl.acm.org/doi/10.1145/3660319.3660330 Live Migration of Multi-Container Kubernetes Pods in Multi-Cluster Serverless Edge Systems]<br /> * 2024-09-04, [https://dl.acm.org/doi/10.1145/3678015.3680477 Towards Efficient End-to-End Encryption for Container Checkpointing Systems]<br /> * 2024-08-04, [https://dl.acm.org/doi/abs/10.1145/3672197.3673432 Custom Page Fault Handling With eBPF]<br /> * 2024-08-03, [https://dl.acm.org/doi/10.1145/3663408.3663416 Software-based Live Migration for Containerized RDMA]<br /> * 2024-07-30, [https://ieeexplore.ieee.org/abstract/document/10606135 Packet Buffering to Minimize Service Downtime and Packet Loss During Redundancy Switchover]<br /> * 2024-07-30, [https://dl.acm.org/doi/abs/10.1145/3664476.3670895 Don't, Stop, Drop, Pause: Forensics of CONtainer CheckPOINTs (ConPoint)]<br /> * 2024-07-25, [https://doi.org/10.1186/s13677-024-00687-9 MDB-KCP: persistence framework of in-memory database with CRIU-based container checkpoint in Kubernetes]<br /> * 2024-07-23, [https://ieeexplore.ieee.org/abstract/document/10631042 Dapper: A Lightweight and Extensible Framework for Live Program State Rewriting]<br /> <br /> <includeonly>: '''[[Articles|More external articles...]]'''</includeonly><noinclude><br /> <br /> * 2024-07-07, [https://ieeexplore.ieee.org/abstract/document/10643902 FastMig: Leveraging FastFreeze to Establish Robust Service Liquidity in Cloud 2.0]<br /> * 2024-07-02, [https://developer.nvidia.com/blog/checkpointing-cuda-applications-with-criu/ Checkpointing CUDA Applications with CRIU]<br /> * 2024-06-19, [https://arxiv.org/abs/2406.13856 Kishu: Time-Traveling for Computational Notebooks]<br /> * 2024-06-09, [https://dl.acm.org/doi/abs/10.1145/3626246.3654752 Demonstration of ElasticNotebook: Migrating Live Computational Notebook States]<br /> * 2024-05-20, [https://arxiv.org/abs/2405.12079 ParallelGPUOS: A Concurrent OS-level GPU Checkpoint and Restore System using Validated Speculation]<br /> * 2024-05-09, [https://www.sciencedirect.com/science/article/pii/S1383762124000948 Practicable live container migrations in high performance computing clouds: Diskless, iterative, and connection-persistent]<br /> * 2024-05-06, [https://ieeexplore.ieee.org/abstract/document/10701375 Workload-Aware Live Migratable Cloud Instance Detector]<br /> * 2024-05-06, [https://ieeexplore.ieee.org/abstract/document/10707218 Migration of Isolated Application Across Heterogeneous Edge Systems]<br /> * 2024-04-26, [https://fis.tu-dresden.de/portal/files/53673228/planeta_bearb_pref2b_20240912193924.pdf Fine-grained OS Control over High-performance Networking]<br /> * 2024-04-22, [https://dl.acm.org/doi/abs/10.1145/3627703.3650085 Just-In-Time Checkpointing: Low Cost Error Recovery from Deep Learning Training Failures]<br /> * 2024-04-22, [https://dl.acm.org/doi/10.1145/3627703.3629556 Pronghorn: Effective Checkpoint Orchestration for Serverless Hot-Starts]<br /> * 2024-01-29, [https://www.sciencedirect.com/science/article/pii/S0167739X24000190 Prebaking runtime environments to improve the FaaS cold start latency]<br /> * 2023-11-27, [https://dl.acm.org/doi/abs/10.1145/3590140.3629121 DynaCut: A Framework for Dynamic and Adaptive Program Customization]<br /> * 2023-11-12, [https://dl.acm.org/doi/10.1145/3624062.3624254 Checkpoint/Restart for CUDA Kernels]<br /> * 2023-11-10, [https://ieeexplore.ieee.org/abstract/document/10314806 Design, Modeling, and Implementation of Robust Migration of Stateful Edge Microservices]<br /> * 2023-10-23, [https://dl.acm.org/doi/10.1145/3605181.3626289 Evicting for the greater good: The Case for Reactive Checkpointing in Serverless Computing]<br /> * 2023-10-01, [https://dl.acm.org/doi/10.14778/3626292.3626296 ElasticNotebook: Enabling Live Migration for Computational Notebooks]<br /> * 2023-09-25, [https://ieeexplore.ieee.org/abstract/document/10419298 Transparent Fault Tolerance for Stateful Applications in Kubernetes with Checkpoint/Restore]<br /> * 2023-07-21, [https://vtechworks.lib.vt.edu/items/20cd28e6-1dba-4c21-b221-59f5f345205f CRIU-RTX: Remote Thread eXecution using Checkpoint/Restore in Userspace]<br /> * 2023-07-10, [https://www.usenix.org/conference/osdi23/presentation/wei-rdma No Provisioned Concurrency: Fast RDMA-codesigned Remote Fork for Serverless Computing]<br /> * 2023-07-06, [https://ieeexplore.ieee.org/abstract/document/10207336 Microservice Debugging with Checkpoint-Restart]<br /> * 2023-05-28, [https://ieeexplore.ieee.org/abstract/document/10278877 Processing-Aware Migration Model for Stateful Edge Microservices]<br /> * 2023-04-20, [https://www.mdpi.com/2504-446X/7/5/286 A Dynamic Checkpoint Interval Decision Algorithm for Live Migration-Based Drone-Recovery System]<br /> * 2023-03-10, [https://kubernetes.io/blog/2023/03/10/forensic-container-analysis/ Forensic Container Analysis]<br /> * 2023-01-31, [https://vtechworks.lib.vt.edu/items/ba974ad9-eac9-4306-b3fc-5f0411b89b99 HetMigrate: Secure and Efficient Cross-architecture Process Live Migration]<br /> * 2023-01-14, [https://arxiv.org/abs/2301.05861 Async-fork: Mitigating Query Latency Spikes Incurred by the Fork-based Snapshot Mechanism from the OS Level]<br /> * 2023-01-10, [https://ieeexplore.ieee.org/abstract/document/10077919 A Container Pre-copy Migration Method Based on Dirty Page Prediction and Compression]<br /> * 2022-11-13, [https://dl.acm.org/doi/abs/10.5555/3571885.3572000 Out of hypervisor (OoH): efficient dirty page tracking in userspace using hardware virtualization feature]<br /> * 2022-08-07, [https://www.sciencedirect.com/science/article/pii/S1084804522001369 iContainer: Consecutive Checkpointing with Rapid Resilience for Immortal Container-based Services]<br /> * 2022-08-03, [https://ieeexplore.ieee.org/document/9844071 Demonstration of Containerized Central Unit Live Migration in 5G Radio Access Network]<br /> * 2022-07-11, [https://www.usenix.org/conference/atc22/presentation/zhou-diyu RRC: Responsive Replicated Containers]<br /> * 2022-05-25, [https://hal.inria.fr/hal-03587358/ Good Shepherds Care For Their Cattle: Seamless Pod Migration in Geo-Distributed Kubernetes]<br /> * 2022-04-24, [https://www.ndss-symposium.org/ndss-paper/auto-draft-295/ FitM: Binary-Only Coverage-Guided Fuzzing for Stateful Network Protocols]<br /> * 2022-03-01, [https://systex22.github.io/papers/systex22-final71.pdf Transparent, Cross-ISA Enclave Offloading]<br /> * 2022-02-25, [https://dl.acm.org/doi/abs/10.1145/3516807.3516817 Portkey: Hypervisor-Assisted Container Migration in Nested Cloud Environments]<br /> * 2022-02-16, [https://arxiv.org/abs/2202.07848 Singularity: Planet-Scale, Preemptible and Elastic Scheduling of AI Workloads]<br /> * 2021-12-17, [https://hal.archives-ouvertes.fr/hal-03487607/document Standard-compliant parallel SystemC simulation of loosely-timed transaction level models: From baremetal to Linux-based applications support]<br /> * 2021-07-14, [https://www.usenix.org/conference/atc21/presentation/planeta MigrOS: Transparent Live-Migration Support for Containerised RDMA Applications]<br /> * 2021-07-06, [https://onlinelibrary.wiley.com/doi/10.1002/cpe.6474 Cricket: A virtualization layer for distributed execution of CUDA applications with checkpoint/restart support]<br /> * 2021-06-07, [https://ieeexplore.ieee.org/abstract/document/9469425 Extending the QUIC Protocol to Support Live Container Migration at the Edge]<br /> * 2021-04-21, [https://dl.acm.org/doi/10.1145/3447786.3456258 On-demand-fork: A Microsecond Fork for Memory-intensive and Latency-sensitive Applications]<br /> * 2021-01-23, [https://arxiv.org/abs/2101.09584 HyCoR: Fault-Tolerant Replicated Containers Based on Checkpoint and Replay]<br /> * 2020-12-11, [https://dl.acm.org/doi/abs/10.1145/3423211.3425682 Prebaking Functions to Warm the Serverless Cold Start]<br /> * 2020-07-14, [https://ieeexplore.ieee.org/abstract/document/9139863 Fault-Tolerant Containers Using NiLiCon]<br /> * 2020-07-08, [https://ieeexplore.ieee.org/document/9126743 Docker Container Deployment in Distributed Fog Infrastructures with Checkpoint/Restart]<br /> * 2020-04-30, [https://dl.acm.org/doi/abs/10.1145/3342195.3387555 Balancing efficiency and fairness in heterogeneous GPU clusters for deep learning]<br /> * 2020-03-17, [https://www.ssrg.ece.vt.edu/papers/vee20-h-container.pdf Edge Computing -- the Case for Heterogeneous-ISA Container Migration]<br /> * 2019-10-03, [https://dl.acm.org/citation.cfm?id=3357542 Fast In-Memory CRIU for Docker Containers]<br /> * 2019-09-24, [https://ieeexplore.ieee.org/document/8916436 Using Container Migration for High Performance Computing (HPC) Workloads Resilience]<br /> * 2019-11-18, [https://ieeexplore.ieee.org/abstract/document/8946189 Optimizing Post-Copy Live Migration with System-Level Checkpoint Using Fabric-Attached Memory]<br /> * 2019-09-11, [https://arxiv.org/pdf/1909.04945.pdf Performance Estimation of Container-Based Cloud-to-Fog Offloading]<br /> * 2019-07-16, [https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=8754197 FastContainer: A Homeostatic System Architecture High-speed Adapting Execution Environment Changes]<br /> * 2019-07-11, [https://ieeexplore.ieee.org/abstract/document/8814504 Exploring Potential for Non-Disruptive Vertical Auto Scaling and Resource Estimation in Kubernetes]<br /> * 2019-07, University of Twente: [https://essay.utwente.nl/78342/1/coenen_MA_EEMCS.pdf Increasing Availability of the AEPU by Improving the Update Process]<br /> * 2019-05-25, [https://dl.acm.org/citation.cfm?id=3303978 Replayable Execution Optimized for Page Sharing for a Managed Runtime Environment]<br /> * 2019-04-29, Binghamton University: [http://www.cs.binghamton.edu/~huilu/pubs/mWarp.pdf mWarp: Accelerating Intra-Host Live Container Migration via Memory Warping]<br /> * 2019-04-10, [https://lisas.de/~adrian/posts/2019-Apr-10-criu-and-selinux.html CRIU and SELinux]<br /> * 2019-03-27, [https://www.mdpi.com/1424-8220/19/7/1488/pdf Container Migration in the Fog: A Performance Evaluation]<br /> * 2019-03-25, [https://dl.acm.org/citation.cfm?id=3313947 Checkpointing and Migration of IoT Edge Functions]<br /> * 2019-03-24, Future University Hakodate: [https://doi.asiabsdcon.org/10.25263/asiabsdcon2019/p07a Yet Another Container Migration on FreeBSD]<br /> * 2019-03-09, [https://link.springer.com/article/10.1007/s10586-019-02920-6 Provenance-based fault tolerance technique recommendation for cloud-based scientific workflows: a practical approach]<br /> * 2019-02-26, Georgia Institute of Technology / Peking University: [https://www.ndss-symposium.org/wp-content/uploads/2019/02/ndss2019_05A-3_Duan_paper.pdf Automating Patching of Vulnerable Open-Source Software Versions in Application Binaries]<br /> * 2019-01-30, University West: [https://www.researchgate.net/publication/330798282_Evaluating_Distributed_MPI_Checkpoint_and_Restore_using_Docker_Containers_and_CRIU Evaluating Distributed MPI Checkpoint and Restore using Docker Containers and CRIU]<br /> * 2018-12, University of Lille: [https://tel.archives-ouvertes.fr/tel-02011337/document Flexible Framework for Elasticity in Cloud Computing]<br /> * 2018-12, Arizona State University: [https://search.proquest.com/openview/ef9070310256fe9ec9a663ebde537b36/1 Concurrent Checkpointing for Embedded Real-Time Systems]<br /> * 2018-11-08, [https://lisas.de/~adrian/posts/2018-Nov-08-criu-configuration-files.html CRIU configuration files]<br /> * 2018-11-06, [https://www.redhat.com/en/blog/using-criu-upgrade-vpn-servers-kernel-without-dropping-connections Using CRIU to upgrade a VPN server's kernel without dropping connections]<br /> * 2018-10-13, [https://dl.acm.org/citation.cfm?id=3290626 Linux Process Tree Reconstruction Using The Attributed Grammar-Based Tree Transformation Model]<br /> * 2018-10-10, [https://podman.io/blogs/2018/10/10/checkpoint-restore.html Adding checkpoint/restore support to Podman]<br /> * 2018-10-08, [https://www.usenix.org/conference/osdi18/presentation/xiao Gandiva: Introspective Cluster Scheduling for Deep Learning]<br /> * 2018-09-15, [https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=8539562 Stateful Container Migration employing Checkpoint-based Restoration for Orchestrated Container Clusters]<br /> * 2018-09-07, [https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=8502659 Container Live Migration for Latency Critical Industrial Applications on Edge Computing]<br /> * 2018-08-15, University of Maryland: [https://drum.lib.umd.edu/bitstream/handle/1903/20499/CS-TR-5056.pdf Fast and Service-preserving Recovery from Malware Infections Using CRIU]<br /> * 2018-07-31, [https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6131214/ Hot-starting software containers for STAR aligner]<br /> * 2018-06-28, University of Aberdeen: [https://link.springer.com/chapter/10.1007/978-3-030-02465-9_13 Efficient Live Migration of Linux Containers]<br /> * 2018-03-24, [https://www.smitechow.com/2018/03/compile-criu-on-centos-6.html Compile CRIU on CentOS 6]<br /> * 2017-12-06, [https://lisas.de/~adrian/posts/2017-Dec-06-optimizing-live-container-migration-in-lxd.html Optimizing live container migration in LXD]<br /> * 2017-10-12, Red Hat Blog: [http://rhelblog.redhat.com/2017/10/12/container-migration-around-the-world/ Container Migration Around The World]<br /> * 2017-07-19, Red Hat Blog: [https://www.redhat.com/en/blog/how-can-process-snapshotrestore-help-save-your-day How can process snapshot/restore help save your day?]<br /> * 2017-06-29, University West, Sweden: [http://www.diva-portal.org/smash/record.jsf?pid=diva2%3A1144045&dswid=4414 Distributed Checkpointing with Docker Containers in High Performance Computing]<br /> * 2017-06-25, [https://ieeexplore.ieee.org/document/8030623 Autonomic Vertical Elasticity of Docker Containers with ELASTICDOCKER]<br /> * 2017-06-06, [https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=7980161 Voyager: Complete Container State Migration]<br /> * 2017-06-06, Selectel Blog: [https://blog.selectel.com/managing-containers-runc/ Managing Containers in runC]<br /> * 2016-12-16, University of Lisbon: [http://www.gsd.inesc-id.pt/~pjpf/ALMA-middleware-2016.pdf ALMA – GC-assisted JVM Live Migration for Java Server Applications]<br /> * 2016-07-20, Red Hat KnowledgeBase: [https://access.redhat.com/articles/2455211 CRIU - Checkpoint/Restore in user space]<br /> * 2016-07-20, LWN.net: [https://lwn.net/SubscriberLink/694593/4d6291b3f727791a/ Quality in open source: testing CRIU]<br /> * 2016-06-22, Usenix: [https://www.usenix.org/conference/atc16/technical-sessions/presentation/kashyap Instant OS Updates via Userspace Checkpoint-and-Restart]<br /> * 2016-05-04: [http://lisas.de/~adrian/?p=1183 Lazy Process Migration]<br /> * 2015-12-31, [http://kimh.github.io/blog/jp/criu/experiment-to-suspend-and-resume-docker-container-with-criu-jp/ Use the CRIU Docker container of stop / resume to the challenge]<br /> * 2015-12-31, [http://blog.codeship.com/how-containers-will-change-the-game-server-hosting-industry/ How Containers Will Change the Game Server Hosting Industry]<br /> * 2015-11-24, [https://dl.acm.org/doi/10.1145/2814576.2814807 Improving Preemptive Scheduling with Application-Transparent Checkpointing in Shared Clusters]<br /> * 2015-09-21, [http://blog.circleci.com/checkpoint-and-restore-docker-container-with-criu/ Checkpoint and restore Docker container with CRIU]<br /> * 2015-09-21, [https://blog.docker.com/2015/09/dolly-demo-linuxcon-runc/ Dolly Demo at LinuxCon: Rapid cloning of existing services with runC]<br /> * 2015-09-10, [http://blog.tonicdev.com/2015/09/10/time-traveling-in-node.js-notebooks.html Time Traveling in Node.js Notebooks]<br /> * 2015-01-01, [http://www.cisco.com/c/dam/en/us/solutions/collateral/data-center-virtualization/openstack-at-cisco/linux-containers-white-paper-cisco-red-hat.pdfLinux Containers: Why They’re in Your Future and What Has to Happen First]<br /> * 2015-07-01, [https://kubernetes.io/blog/2015/07/how-did-quake-demo-from-dockercon-work/ How did the Quake demo from DockerCon Work?]<br /> * 2015-05-06, [https://insights.ubuntu.com/2015/05/06/live-migration-in-lxd/ Live Migration in LXD] Ubuntu Insignts<br /> * 2015-04-22, TuxDiary [http://tuxdiary.com/2015/04/22/dump-debug-resume-process-criu/ Dump, debug, resume process with criu]<br /> * 2014-12-12, Symposium on Information and Communication Systems (SInCom 2014) [https://lisas.de/~adrian/proceedingsSInCom2014.pdf Checkpoint/Restore in User-Space with Open MPI]<br /> * 2014-09-31, [http://www.reuters.com/article/wa-parallels-idUSnBw035202a+100+BSW20141103 Parallels Surpasses One Million Deployed Virtual Containers]<br /> * 2014-08-01, ADMIN magazine: [http://www.admin-magazine.com/Archive/2014/22/Save-and-Restore-Linux-Processes-with-CRIU Save and Restore Linux Processes with CRIU]<br /> * 2014-02-15, OCCAM Reproduce: [http://heirman.net/papers/reproduce2014.pdf Efficient, Accurate and Reproducible Simulation of Multi-Threaded Workloads] ([http://www.occamportal.org/slides/reproduce/reproduce14_slides_05.pdf slides])<br /> * 2013-11-25, Phoronix: [http://www.phoronix.com/scan.php?page=news_item&px=MTUyNjE Checkpoint-Restore Hits v1.0: Freeze Your Linux Apps]<br /> * 2013-11-25, LWN: [http://lwn.net/Articles/574918/ A note about 1.0]<br /> * 2013-10-29, LWN: [http://lwn.net/Articles/572125/ Kernel summit report]<br /> * 2013-02-01, A blog [http://www.anchor.com.au/blog/2013/02/overview-of-checkpoint-and-restore-live-migrating-processes-on-a-linux-system/ post] upon LCA-2013 talk.<br /> * 2013-01-09, LWN: [http://lwn.net/Articles/531939/ Checkpoint/restore and signals]<br /> * 2012-11-20, LWN: [http://lwn.net/Articles/525675/ LCE: Checkpoint/restore in user space: are we there yet?]<br /> * 2012-07-24, OpenVZ blog: [http://openvz.livejournal.com/42414.html CRtools 0.1 released!]<br /> * 2012-05-01, LWN: [http://lwn.net/Articles/495304/ TCP connection repair]<br /> * 2012-02-26, The International Symposium on Grids and Clouds (ISGC) [https://lisas.de/~adrian/ISGC-2012_031.pdf Pos (isgc 2012) 031 live process migration for load balancing and/or fault tolerance]<br /> * 2012-01-31, LWN: [http://lwn.net/Articles/478111/ Preparing for user-space checkpoint/restore]<br /> * 2011-07-19, LWN: [http://lwn.net/Articles/452184/ Checkpoint/restart (mostly) in user space]<br /> <br /> === In Russian ===<br /> * 13.05.2016, Habrahabr: [https://habrahabr.ru/post/283504/ Особенности тестирования технологии C/R в Linux]<br /> * 09.03.2016, Opennet: [http://www.opennet.ru/opennews/art.shtml?num=44015 Выпуск CRIU 2.0, системы для сохранения и восстановления состояния процессов в Linux]<br /> * 18.12.2015, Opennet: [http://www.opennet.ru/opennews/art.shtml?num=43539 CRIU, путь от вызывающей непонимание разработки до интеграции в Red Hat Enterprise Linux] <br /> * 09.12.2015, Opennet: [http://www.opennet.ru/opennews/art.shtml?num=43489 Выпуск CRIU 1.8, системы для сохранения и восстановления состояния процессов в Linux] <br /> * 09.09.2015, Opennet: [http://www.opennet.ru/opennews/art.shtml?num=42939 Выпуск CRIU 1.7, системы для сохранения и восстановления состояния процессов в Linux]<br /> * 25.08.2015, Opennet: [http://www.opennet.ru/opennews/art.shtml?num=42850 Проект OpenVZ анонсировал новый компонент для миграции Linux контейнеров - P.Haul]<br /> * 27.05.2015, Opennet: [http://www.opennet.ru/opennews/art.shtml?num=42315 Статус интеграции проектов CRIU и Docker]<br /> * 25.11.2013, Opennet: [http://www.opennet.ru/opennews/art.shtml?num=38519 Анонс выхода 1.0]<br /> * 28.04.2015, Типичный программист: [http://tproger.ru/interview/pavel-emelyanov/ Разработка ядра Linux — это общение в клубе по интересам]<br /> * 22.04.2013, Habrahabr: [http://habrahabr.ru/post/177499/ В преддверии очередного релиза CRIU]<br /> * 04.03.2013, IT-computer: [http://www.it-computer.com/osvaivaem-sistemu-zamorozki-processov-criu Осваиваем систему заморозки процессов CRIU]<br /> * 28.09.2012, Opennet: [http://www.opennet.ru/opennews/art.shtml?num=34958 CRIU 0.2 release] <br /> * 05.11.2013, Xakep: [https://xakep.ru/2013/11/05/criu-manual/ Осваиваем систему заморозки процессов CRIU]<br /> * 15.08.2013, Habrahabr: [http://habrahabr.ru/company/parallels/blog/190066/ «Разработка ядра Linux — это общение в клубе по интересам»]<br /> * 01.10.2012, YaC 2012: [http://events.yandex.ru/events/yac/2012/talks/352/ больше, чем живая миграция для Linux контейнеров]<br /> * 24.07.2012, Habrahabr: [http://habrahabr.ru/post/148413/ CRIU — новый амбициозный проект для сохранения и восстановления состояния процессов]<br /> * 24.07.2012, Ru-OpenVZ blog: [http://ru-openvz.livejournal.com/5753.html Вышел первый релиз CRtools, версия 0.1]<br /> * 24.07.2012, Opennet: [http://www.opennet.ru/opennews/art.shtml?num=34408 Первый релиз CRtools, утилиты для заморозки и восстановления состояния процессов в Linux]<br /> * 24.07.2012, LOR: [http://www.linux.org.ru/news/kernel/8021514 Вышел первый релиз CRtools, версия 0.1]<br /> * Копипаста о v0.1 "CRIU / CRtools 0.1 — создание контрольных точек Linux-приложений и восстановление с них": [http://rosinvest.com/novosti/949423 Rosinvest], [http://www.nixp.ru/news/11854.html NIXP] [http://pcnews.ru/top/news/day/criu-crtools-linux-openvz-checkpoint-restore-in-userspace-cpt-system-90-10-lxc-org-398305.html PCNews]<br /> </noinclude></div>

Wenhuizhang https://criu.org/index.php?title=Articles&diff=5573 Articles 2024-12-18T02:26:57Z

<p>Wenhuizhang: delete deplicated ones</p> <hr /> <div><noinclude>This is a collection of external articles regarding the CRIU project, sorted by date.<br /> <br /> </noinclude><br /> * 2024-11-14, [https://dl.acm.org/doi/10.1145/3698038.3698510 On-demand and Parallel Checkpoint/Restore for GPU Applications]<br /> * 2024-09-06, [https://dl.acm.org/doi/10.1145/3660319.3660330 Live Migration of Multi-Container Kubernetes Pods in Multi-Cluster Serverless Edge Systems]<br /> * 2024-09-04, [https://dl.acm.org/doi/10.1145/3678015.3680477 Towards Efficient End-to-End Encryption for Container Checkpointing Systems]<br /> * 2024-08-04, [https://dl.acm.org/doi/abs/10.1145/3672197.3673432 Custom Page Fault Handling With eBPF]<br /> * 2024-08-03, [https://dl.acm.org/doi/10.1145/3663408.3663416 Software-based Live Migration for Containerized RDMA]<br /> * 2024-07-30, [https://ieeexplore.ieee.org/abstract/document/10606135 Packet Buffering to Minimize Service Downtime and Packet Loss During Redundancy Switchover]<br /> * 2024-07-30, [https://dl.acm.org/doi/abs/10.1145/3664476.3670895 Don't, Stop, Drop, Pause: Forensics of CONtainer CheckPOINTs (ConPoint)]<br /> * 2024-07-25, [https://doi.org/10.1186/s13677-024-00687-9 MDB-KCP: persistence framework of in-memory database with CRIU-based container checkpoint in Kubernetes]<br /> * 2024-07-23, [https://ieeexplore.ieee.org/abstract/document/10631042 Dapper: A Lightweight and Extensible Framework for Live Program State Rewriting]<br /> <br /> <includeonly>: '''[[Articles|More external articles...]]'''</includeonly><noinclude><br /> <br /> * 2024-07-07, [https://ieeexplore.ieee.org/abstract/document/10643902 FastMig: Leveraging FastFreeze to Establish Robust Service Liquidity in Cloud 2.0]<br /> * 2024-07-02, [https://developer.nvidia.com/blog/checkpointing-cuda-applications-with-criu/ Checkpointing CUDA Applications with CRIU]<br /> * 2024-06-19, [https://arxiv.org/abs/2406.13856 Kishu: Time-Traveling for Computational Notebooks]<br /> * 2024-06-09, [https://dl.acm.org/doi/abs/10.1145/3626246.3654752 Demonstration of ElasticNotebook: Migrating Live Computational Notebook States]<br /> * 2024-05-20, [https://arxiv.org/abs/2405.12079 ParallelGPUOS: A Concurrent OS-level GPU Checkpoint and Restore System using Validated Speculation]<br /> * 2024-05-09, [https://www.sciencedirect.com/science/article/pii/S1383762124000948 Practicable live container migrations in high performance computing clouds: Diskless, iterative, and connection-persistent]<br /> * 2024-05-06, [https://ieeexplore.ieee.org/abstract/document/10701375 Workload-Aware Live Migratable Cloud Instance Detector]<br /> * 2024-05-06, [https://ieeexplore.ieee.org/abstract/document/10707218 Migration of Isolated Application Across Heterogeneous Edge Systems]<br /> * 2024-04-26, [https://fis.tu-dresden.de/portal/files/53673228/planeta_bearb_pref2b_20240912193924.pdf Fine-grained OS Control over High-performance Networking]<br /> * 2024-04-22, [https://dl.acm.org/doi/abs/10.1145/3627703.3650085 Just-In-Time Checkpointing: Low Cost Error Recovery from Deep Learning Training Failures]<br /> * 2024-04-22, [https://dl.acm.org/doi/10.1145/3627703.3629556 Pronghorn: Effective Checkpoint Orchestration for Serverless Hot-Starts]<br /> * 2024-01-29, [https://www.sciencedirect.com/science/article/pii/S0167739X24000190 Prebaking runtime environments to improve the FaaS cold start latency]<br /> * 2023-11-27, [https://dl.acm.org/doi/abs/10.1145/3590140.3629121 DynaCut: A Framework for Dynamic and Adaptive Program Customization]<br /> * 2023-11-12, [https://dl.acm.org/doi/10.1145/3624062.3624254 Checkpoint/Restart for CUDA Kernels]<br /> * 2023-11-10, [https://ieeexplore.ieee.org/abstract/document/10314806 Design, Modeling, and Implementation of Robust Migration of Stateful Edge Microservices]<br /> * 2023-10-23, [https://dl.acm.org/doi/10.1145/3605181.3626289 Evicting for the greater good: The Case for Reactive Checkpointing in Serverless Computing]<br /> * 2023-10-01, [https://dl.acm.org/doi/10.14778/3626292.3626296 ElasticNotebook: Enabling Live Migration for Computational Notebooks]<br /> * 2023-09-25, [https://ieeexplore.ieee.org/abstract/document/10419298 Transparent Fault Tolerance for Stateful Applications in Kubernetes with Checkpoint/Restore]<br /> * 2023-07-21, [https://vtechworks.lib.vt.edu/items/20cd28e6-1dba-4c21-b221-59f5f345205f CRIU-RTX: Remote Thread eXecution using Checkpoint/Restore in Userspace]<br /> * 2023-07-10, [https://www.usenix.org/conference/osdi23/presentation/wei-rdma No Provisioned Concurrency: Fast RDMA-codesigned Remote Fork for Serverless Computing]<br /> * 2023-07-06, [https://ieeexplore.ieee.org/abstract/document/10207336 Microservice Debugging with Checkpoint-Restart]<br /> * 2023-05-28, [https://ieeexplore.ieee.org/abstract/document/10278877 Processing-Aware Migration Model for Stateful Edge Microservices]<br /> * 2023-04-20, [https://www.mdpi.com/2504-446X/7/5/286 A Dynamic Checkpoint Interval Decision Algorithm for Live Migration-Based Drone-Recovery System]<br /> * 2023-03-10, [https://kubernetes.io/blog/2023/03/10/forensic-container-analysis/ Forensic Container Analysis]<br /> * 2023-01-31, [https://vtechworks.lib.vt.edu/items/ba974ad9-eac9-4306-b3fc-5f0411b89b99 HetMigrate: Secure and Efficient Cross-architecture Process Live Migration]<br /> * 2023-01-14, [https://arxiv.org/abs/2301.05861 Async-fork: Mitigating Query Latency Spikes Incurred by the Fork-based Snapshot Mechanism from the OS Level]<br /> * 2023-01-10, [https://ieeexplore.ieee.org/abstract/document/10077919 A Container Pre-copy Migration Method Based on Dirty Page Prediction and Compression]<br /> * 2022-11-13, [https://dl.acm.org/doi/abs/10.5555/3571885.3572000 Out of hypervisor (OoH): efficient dirty page tracking in userspace using hardware virtualization feature]<br /> * 2022-08-07, [https://www.sciencedirect.com/science/article/pii/S1084804522001369 iContainer: Consecutive Checkpointing with Rapid Resilience for Immortal Container-based Services]<br /> * 2022-08-03, [https://ieeexplore.ieee.org/document/9844071 Demonstration of Containerized Central Unit Live Migration in 5G Radio Access Network]<br /> * 2022-07-11, [https://www.usenix.org/conference/atc22/presentation/zhou-diyu RRC: Responsive Replicated Containers]<br /> * 2022-05-25, [https://hal.inria.fr/hal-03587358/ Good Shepherds Care For Their Cattle: Seamless Pod Migration in Geo-Distributed Kubernetes]<br /> * 2022-04-24, [https://www.ndss-symposium.org/ndss-paper/auto-draft-295/ FitM: Binary-Only Coverage-Guided Fuzzing for Stateful Network Protocols]<br /> * 2022-03-01, [https://systex22.github.io/papers/systex22-final71.pdf Transparent, Cross-ISA Enclave Offloading]<br /> * 2022-02-25, [https://dl.acm.org/doi/abs/10.1145/3516807.3516817 Portkey: Hypervisor-Assisted Container Migration in Nested Cloud Environments]<br /> * 2022-02-16, [https://arxiv.org/abs/2202.07848 Singularity: Planet-Scale, Preemptible and Elastic Scheduling of AI Workloads]<br /> * 2021-12-17, [https://hal.archives-ouvertes.fr/hal-03487607/document Standard-compliant parallel SystemC simulation of loosely-timed transaction level models: From baremetal to Linux-based applications support]<br /> * 2021-08-13, [https://doi.org/10.11591/eei.v10i2.2742 Live migration using checkpoint and restore in userspace (CRIU): Usage analysis of network, memory and CPU]<br /> * 2021-07-14, [https://www.usenix.org/conference/atc21/presentation/planeta MigrOS: Transparent Live-Migration Support for Containerised RDMA Applications]<br /> * 2021-07-06, [https://onlinelibrary.wiley.com/doi/10.1002/cpe.6474 Cricket: A virtualization layer for distributed execution of CUDA applications with checkpoint/restart support]<br /> * 2021-06-07, [https://ieeexplore.ieee.org/abstract/document/9469425 Extending the QUIC Protocol to Support Live Container Migration at the Edge]<br /> * 2021-04-21, [https://dl.acm.org/doi/10.1145/3447786.3456258 On-demand-fork: A Microsecond Fork for Memory-intensive and Latency-sensitive Applications]<br /> * 2021-01-23, [https://arxiv.org/abs/2101.09584 HyCoR: Fault-Tolerant Replicated Containers Based on Checkpoint and Replay]<br /> * 2020-12-11, [https://dl.acm.org/doi/abs/10.1145/3423211.3425682 Prebaking Functions to Warm the Serverless Cold Start]<br /> * 2020-07-14, [https://ieeexplore.ieee.org/abstract/document/9139863 Fault-Tolerant Containers Using NiLiCon]<br /> * 2020-07-08, [https://ieeexplore.ieee.org/document/9126743 Docker Container Deployment in Distributed Fog Infrastructures with Checkpoint/Restart]<br /> * 2020-04-30, [https://dl.acm.org/doi/abs/10.1145/3342195.3387555 Balancing efficiency and fairness in heterogeneous GPU clusters for deep learning]<br /> * 2020-03-17, [https://www.ssrg.ece.vt.edu/papers/vee20-h-container.pdf Edge Computing -- the Case for Heterogeneous-ISA Container Migration]<br /> * 2019-10-03, [https://dl.acm.org/citation.cfm?id=3357542 Fast In-Memory CRIU for Docker Containers]<br /> * 2019-09-24, [https://ieeexplore.ieee.org/document/8916436 Using Container Migration for High Performance Computing (HPC) Workloads Resilience]<br /> * 2019-11-18, [https://ieeexplore.ieee.org/abstract/document/8946189 Optimizing Post-Copy Live Migration with System-Level Checkpoint Using Fabric-Attached Memory]<br /> * 2019-09-11, [https://arxiv.org/pdf/1909.04945.pdf Performance Estimation of Container-Based Cloud-to-Fog Offloading]<br /> * 2019-07-16, [https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=8754197 FastContainer: A Homeostatic System Architecture High-speed Adapting Execution Environment Changes]<br /> * 2019-07-11, [https://ieeexplore.ieee.org/abstract/document/8814504 Exploring Potential for Non-Disruptive Vertical Auto Scaling and Resource Estimation in Kubernetes]<br /> * 2019-07, University of Twente: [https://essay.utwente.nl/78342/1/coenen_MA_EEMCS.pdf Increasing Availability of the AEPU by Improving the Update Process]<br /> * 2019-05-25, [https://dl.acm.org/citation.cfm?id=3303978 Replayable Execution Optimized for Page Sharing for a Managed Runtime Environment]<br /> * 2019-04-29, Binghamton University: [http://www.cs.binghamton.edu/~huilu/pubs/mWarp.pdf mWarp: Accelerating Intra-Host Live Container Migration via Memory Warping]<br /> * 2019-04-10, [https://lisas.de/~adrian/posts/2019-Apr-10-criu-and-selinux.html CRIU and SELinux]<br /> * 2019-03-27, [https://www.mdpi.com/1424-8220/19/7/1488/pdf Container Migration in the Fog: A Performance Evaluation]<br /> * 2019-03-25, [https://dl.acm.org/citation.cfm?id=3313947 Checkpointing and Migration of IoT Edge Functions]<br /> * 2019-03-24, Future University Hakodate: [https://doi.asiabsdcon.org/10.25263/asiabsdcon2019/p07a Yet Another Container Migration on FreeBSD]<br /> * 2019-03-09, [https://link.springer.com/article/10.1007/s10586-019-02920-6 Provenance-based fault tolerance technique recommendation for cloud-based scientific workflows: a practical approach]<br /> * 2019-02-26, Georgia Institute of Technology / Peking University: [https://www.ndss-symposium.org/wp-content/uploads/2019/02/ndss2019_05A-3_Duan_paper.pdf Automating Patching of Vulnerable Open-Source Software Versions in Application Binaries]<br /> * 2019-01-30, University West: [https://www.researchgate.net/publication/330798282_Evaluating_Distributed_MPI_Checkpoint_and_Restore_using_Docker_Containers_and_CRIU Evaluating Distributed MPI Checkpoint and Restore using Docker Containers and CRIU]<br /> * 2018-12, University of Lille: [https://tel.archives-ouvertes.fr/tel-02011337/document Flexible Framework for Elasticity in Cloud Computing]<br /> * 2018-12, Arizona State University: [https://search.proquest.com/openview/ef9070310256fe9ec9a663ebde537b36/1 Concurrent Checkpointing for Embedded Real-Time Systems]<br /> * 2018-11-08, [https://lisas.de/~adrian/posts/2018-Nov-08-criu-configuration-files.html CRIU configuration files]<br /> * 2018-11-06, [https://www.redhat.com/en/blog/using-criu-upgrade-vpn-servers-kernel-without-dropping-connections Using CRIU to upgrade a VPN server's kernel without dropping connections]<br /> * 2018-10-13, [https://dl.acm.org/citation.cfm?id=3290626 Linux Process Tree Reconstruction Using The Attributed Grammar-Based Tree Transformation Model]<br /> * 2018-10-10, [https://podman.io/blogs/2018/10/10/checkpoint-restore.html Adding checkpoint/restore support to Podman]<br /> * 2018-10-08, [https://www.usenix.org/conference/osdi18/presentation/xiao Gandiva: Introspective Cluster Scheduling for Deep Learning]<br /> * 2018-09-15, [https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=8539562 Stateful Container Migration employing Checkpoint-based Restoration for Orchestrated Container Clusters]<br /> * 2018-09-07, [https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=8502659 Container Live Migration for Latency Critical Industrial Applications on Edge Computing]<br /> * 2018-08-15, University of Maryland: [https://drum.lib.umd.edu/bitstream/handle/1903/20499/CS-TR-5056.pdf Fast and Service-preserving Recovery from Malware Infections Using CRIU]<br /> * 2018-07-31, [https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6131214/ Hot-starting software containers for STAR aligner]<br /> * 2018-07-07, Moscow Institute of Physics and Technology: [https://pdfs.semanticscholar.org/9ac4/f8ab4fd0492bfdc503831f60a5ce3d1d50a5.pdf?_ga=2.17262585.1140385641.1554239661-2109847679.1554239661 Using CRIU with HPC Containers: Field Experience]<br /> * 2018-06-28, University of Aberdeen: [https://link.springer.com/chapter/10.1007/978-3-030-02465-9_13 Efficient Live Migration of Linux Containers]<br /> * 2018-03-24, [https://www.smitechow.com/2018/03/compile-criu-on-centos-6.html Compile CRIU on CentOS 6]<br /> * 2017-12-06, [https://lisas.de/~adrian/posts/2017-Dec-06-optimizing-live-container-migration-in-lxd.html Optimizing live container migration in LXD]<br /> * 2017-10-12, Red Hat Blog: [http://rhelblog.redhat.com/2017/10/12/container-migration-around-the-world/ Container Migration Around The World]<br /> * 2017-07-19, Red Hat Blog: [https://www.redhat.com/en/blog/how-can-process-snapshotrestore-help-save-your-day How can process snapshot/restore help save your day?]<br /> * 2017-06-29, University West, Sweden: [http://www.diva-portal.org/smash/record.jsf?pid=diva2%3A1144045&dswid=4414 Distributed Checkpointing with Docker Containers in High Performance Computing]<br /> * 2017-06-25, [https://ieeexplore.ieee.org/document/8030623 Autonomic Vertical Elasticity of Docker Containers with ELASTICDOCKER]<br /> * 2017-06-06, [https://ieeexplore.ieee.org/stamp/stamp.jsp?arnumber=7980161 Voyager: Complete Container State Migration]<br /> * 2017-06-06, Selectel Blog: [https://blog.selectel.com/managing-containers-runc/ Managing Containers in runC]<br /> * 2016-12-16, University of Lisbon: [http://www.gsd.inesc-id.pt/~pjpf/ALMA-middleware-2016.pdf ALMA – GC-assisted JVM Live Migration for Java Server Applications]<br /> * 2016-07-20, Red Hat KnowledgeBase: [https://access.redhat.com/articles/2455211 CRIU - Checkpoint/Restore in user space]<br /> * 2016-07-20, LWN.net: [https://lwn.net/SubscriberLink/694593/4d6291b3f727791a/ Quality in open source: testing CRIU]<br /> * 2016-06-22, Usenix: [https://www.usenix.org/conference/atc16/technical-sessions/presentation/kashyap Instant OS Updates via Userspace Checkpoint-and-Restart]<br /> * 2016-05-04: [http://lisas.de/~adrian/?p=1183 Lazy Process Migration]<br /> * 2015-12-31, [http://kimh.github.io/blog/jp/criu/experiment-to-suspend-and-resume-docker-container-with-criu-jp/ Use the CRIU Docker container of stop / resume to the challenge]<br /> * 2015-12-31, [http://blog.codeship.com/how-containers-will-change-the-game-server-hosting-industry/ How Containers Will Change the Game Server Hosting Industry]<br /> * 2015-11-24, [https://dl.acm.org/doi/10.1145/2814576.2814807 Improving Preemptive Scheduling with Application-Transparent Checkpointing in Shared Clusters]<br /> * 2015-09-21, [http://blog.circleci.com/checkpoint-and-restore-docker-container-with-criu/ Checkpoint and restore Docker container with CRIU]<br /> * 2015-09-21, [https://blog.docker.com/2015/09/dolly-demo-linuxcon-runc/ Dolly Demo at LinuxCon: Rapid cloning of existing services with runC]<br /> * 2015-09-10, [http://blog.tonicdev.com/2015/09/10/time-traveling-in-node.js-notebooks.html Time Traveling in Node.js Notebooks]<br /> * 2015-01-01, [http://www.cisco.com/c/dam/en/us/solutions/collateral/data-center-virtualization/openstack-at-cisco/linux-containers-white-paper-cisco-red-hat.pdfLinux Containers: Why They’re in Your Future and What Has to Happen First]<br /> * 2015-07-01, [https://kubernetes.io/blog/2015/07/how-did-quake-demo-from-dockercon-work/ How did the Quake demo from DockerCon Work?]<br /> * 2015-05-06, [https://insights.ubuntu.com/2015/05/06/live-migration-in-lxd/ Live Migration in LXD] Ubuntu Insignts<br /> * 2015-04-22, TuxDiary [http://tuxdiary.com/2015/04/22/dump-debug-resume-process-criu/ Dump, debug, resume process with criu]<br /> * 2014-12-12, Symposium on Information and Communication Systems (SInCom 2014) [https://lisas.de/~adrian/proceedingsSInCom2014.pdf Checkpoint/Restore in User-Space with Open MPI]<br /> * 2014-09-31, [http://www.reuters.com/article/wa-parallels-idUSnBw035202a+100+BSW20141103 Parallels Surpasses One Million Deployed Virtual Containers]<br /> * 2014-08-01, ADMIN magazine: [http://www.admin-magazine.com/Archive/2014/22/Save-and-Restore-Linux-Processes-with-CRIU Save and Restore Linux Processes with CRIU]<br /> * 2014-02-15, OCCAM Reproduce: [http://heirman.net/papers/reproduce2014.pdf Efficient, Accurate and Reproducible Simulation of Multi-Threaded Workloads] ([http://www.occamportal.org/slides/reproduce/reproduce14_slides_05.pdf slides])<br /> * 2013-11-25, Phoronix: [http://www.phoronix.com/scan.php?page=news_item&px=MTUyNjE Checkpoint-Restore Hits v1.0: Freeze Your Linux Apps]<br /> * 2013-11-25, LWN: [http://lwn.net/Articles/574918/ A note about 1.0]<br /> * 2013-10-29, LWN: [http://lwn.net/Articles/572125/ Kernel summit report]<br /> * 2013-02-01, A blog [http://www.anchor.com.au/blog/2013/02/overview-of-checkpoint-and-restore-live-migrating-processes-on-a-linux-system/ post] upon LCA-2013 talk.<br /> * 2013-01-09, LWN: [http://lwn.net/Articles/531939/ Checkpoint/restore and signals]<br /> * 2012-11-20, LWN: [http://lwn.net/Articles/525675/ LCE: Checkpoint/restore in user space: are we there yet?]<br /> * 2012-07-24, OpenVZ blog: [http://openvz.livejournal.com/42414.html CRtools 0.1 released!]<br /> * 2012-05-01, LWN: [http://lwn.net/Articles/495304/ TCP connection repair]<br /> * 2012-02-26, The International Symposium on Grids and Clouds (ISGC) [https://lisas.de/~adrian/ISGC-2012_031.pdf Pos (isgc 2012) 031 live process migration for load balancing and/or fault tolerance]<br /> * 2012-01-31, LWN: [http://lwn.net/Articles/478111/ Preparing for user-space checkpoint/restore]<br /> * 2011-07-19, LWN: [http://lwn.net/Articles/452184/ Checkpoint/restart (mostly) in user space]<br /> <br /> === In Russian ===<br /> * 13.05.2016, Habrahabr: [https://habrahabr.ru/post/283504/ Особенности тестирования технологии C/R в Linux]<br /> * 09.03.2016, Opennet: [http://www.opennet.ru/opennews/art.shtml?num=44015 Выпуск CRIU 2.0, системы для сохранения и восстановления состояния процессов в Linux]<br /> * 18.12.2015, Opennet: [http://www.opennet.ru/opennews/art.shtml?num=43539 CRIU, путь от вызывающей непонимание разработки до интеграции в Red Hat Enterprise Linux] <br /> * 09.12.2015, Opennet: [http://www.opennet.ru/opennews/art.shtml?num=43489 Выпуск CRIU 1.8, системы для сохранения и восстановления состояния процессов в Linux] <br /> * 09.09.2015, Opennet: [http://www.opennet.ru/opennews/art.shtml?num=42939 Выпуск CRIU 1.7, системы для сохранения и восстановления состояния процессов в Linux]<br /> * 25.08.2015, Opennet: [http://www.opennet.ru/opennews/art.shtml?num=42850 Проект OpenVZ анонсировал новый компонент для миграции Linux контейнеров - P.Haul]<br /> * 27.05.2015, Opennet: [http://www.opennet.ru/opennews/art.shtml?num=42315 Статус интеграции проектов CRIU и Docker]<br /> * 25.11.2013, Opennet: [http://www.opennet.ru/opennews/art.shtml?num=38519 Анонс выхода 1.0]<br /> * 28.04.2015, Типичный программист: [http://tproger.ru/interview/pavel-emelyanov/ Разработка ядра Linux — это общение в клубе по интересам]<br /> * 22.04.2013, Habrahabr: [http://habrahabr.ru/post/177499/ В преддверии очередного релиза CRIU]<br /> * 04.03.2013, IT-computer: [http://www.it-computer.com/osvaivaem-sistemu-zamorozki-processov-criu Осваиваем систему заморозки процессов CRIU]<br /> * 28.09.2012, Opennet: [http://www.opennet.ru/opennews/art.shtml?num=34958 CRIU 0.2 release] <br /> * 05.11.2013, Xakep: [https://xakep.ru/2013/11/05/criu-manual/ Осваиваем систему заморозки процессов CRIU]<br /> * 15.08.2013, Habrahabr: [http://habrahabr.ru/company/parallels/blog/190066/ «Разработка ядра Linux — это общение в клубе по интересам»]<br /> * 01.10.2012, YaC 2012: [http://events.yandex.ru/events/yac/2012/talks/352/ больше, чем живая миграция для Linux контейнеров]<br /> * 24.07.2012, Habrahabr: [http://habrahabr.ru/post/148413/ CRIU — новый амбициозный проект для сохранения и восстановления состояния процессов]<br /> * 24.07.2012, Ru-OpenVZ blog: [http://ru-openvz.livejournal.com/5753.html Вышел первый релиз CRtools, версия 0.1]<br /> * 24.07.2012, Opennet: [http://www.opennet.ru/opennews/art.shtml?num=34408 Первый релиз CRtools, утилиты для заморозки и восстановления состояния процессов в Linux]<br /> * 24.07.2012, LOR: [http://www.linux.org.ru/news/kernel/8021514 Вышел первый релиз CRtools, версия 0.1]<br /> * Копипаста о v0.1 "CRIU / CRtools 0.1 — создание контрольных точек Linux-приложений и восстановление с них": [http://rosinvest.com/novosti/949423 Rosinvest], [http://www.nixp.ru/news/11854.html NIXP] [http://pcnews.ru/top/news/day/criu-crtools-linux-openvz-checkpoint-restore-in-userspace-cpt-system-90-10-lxc-org-398305.html PCNews]<br /> </noinclude></div>

Wenhuizhang https://criu.org/index.php?title=Academic_Research&diff=5572 Academic Research 2024-12-10T23:49:47Z

<p>Wenhuizhang: </p> <hr /> <div>* GPU CRIU<br /> <br /> [SoCC '24] On-demand and Parallel Checkpoint/Restore for GPU Applications<br /> <br /> [arXiv '23] PARALLELGPUOS: A Concurrent OS-level GPU Checkpoint and Restore System using Validated Speculation<br /> <br /> [SC-W '23] Checkpoint/Restart for CUDA Kernels<br /> <br /> <br /> <br /> * CRIU for Migration<br /> <br /> [APNet '24] Software-based Live Migration for Containerized RDMA<br /> <br /> [SEATED '24] Live Migration of Multi-Container Kubernetes Pods in Multi-Cluster Serverless Edge Systems<br /> <br /> [ICT '24] Packet Buffering to Minimize Service Downtime and Packet Loss During Redundancy Switchover<br /> <br /> [SIGMOD/PODS '24] Demonstration of ElasticNotebook: Migrating Live Computational Notebook States<br /> <br /> [ICDCS '24] Dapper: A Lightweight and Extensible Framework for Live Program State Rewriting<br /> <br /> [Cloud '24] FastMig: Leveraging FastFreeze to Establish Robust Service Liquidity in Cloud 2.0<br /> <br /> [TOCS '22] H-Container: Enabling Heterogeneous-ISA Container Migration in Edge Computing<br /> <br /> [VEE '22] Portkey: hypervisor-assisted container migration in nested cloud environments<br /> <br /> <br /> * CRIU Security<br /> <br /> [APSys '24] Towards Efficient End-to-End Encryption for Container Checkpointing Systems<br /> <br /> [eBPF '24] Custom Page Fault Handling With eBPF<br /> <br /> [ARES '24] Don't, Stop, Drop, Pause: Forensics of CONtainer CheckPOINTs (ConPoint)<br /> <br /> [ATC '22] RRC: Responsive Replicated Containers<br /> <br /> <br /> * CRIU for Database<br /> <br /> [Journal of Cloud Computing '24] MDB-KCP: persistence framework of in-memory database with CRIU-based container checkpoint in Kubernetes<br /> <br /> [VLDB '23] Async-fork: Mitigating Query Latency Spikes Incurred by the Fork-based Snapshot Mechanism from the OS Level<br /> <br /> [EuroSys '21] On-demand-fork: a microsecond fork for memory-intensive and latency-sensitive applications</div>

Wenhuizhang https://criu.org/index.php?title=Academic_Research&diff=5571 Academic Research 2024-12-10T23:43:49Z

<p>Wenhuizhang: </p> <hr /> <div>* GPU CRIU<br /> <br /> [SoCC '24] On-demand and Parallel Checkpoint/Restore for GPU Applications<br /> <br /> [SC-W '23] Checkpoint/Restart for CUDA Kernels<br /> <br /> <br /> * CRIU for Migration<br /> <br /> [APNet '24] Software-based Live Migration for Containerized RDMA<br /> <br /> [SEATED '24] Live Migration of Multi-Container Kubernetes Pods in Multi-Cluster Serverless Edge Systems<br /> <br /> [ICT '24] Packet Buffering to Minimize Service Downtime and Packet Loss During Redundancy Switchover<br /> <br /> [SIGMOD/PODS '24] Demonstration of ElasticNotebook: Migrating Live Computational Notebook States<br /> <br /> [ICDCS '24] Dapper: A Lightweight and Extensible Framework for Live Program State Rewriting<br /> <br /> [Cloud '24] FastMig: Leveraging FastFreeze to Establish Robust Service Liquidity in Cloud 2.0<br /> <br /> [TOCS '22] H-Container: Enabling Heterogeneous-ISA Container Migration in Edge Computing<br /> <br /> [VEE '22] Portkey: hypervisor-assisted container migration in nested cloud environments<br /> <br /> <br /> * CRIU Security<br /> <br /> [APSys '24] Towards Efficient End-to-End Encryption for Container Checkpointing Systems<br /> <br /> [eBPF '24] Custom Page Fault Handling With eBPF<br /> <br /> [ARES '24] Don't, Stop, Drop, Pause: Forensics of CONtainer CheckPOINTs (ConPoint)<br /> <br /> [ATC '22] RRC: Responsive Replicated Containers<br /> <br /> <br /> * CRIU for Database<br /> <br /> [Journal of Cloud Computing '24] MDB-KCP: persistence framework of in-memory database with CRIU-based container checkpoint in Kubernetes<br /> <br /> [VLDB '23] Async-fork: Mitigating Query Latency Spikes Incurred by the Fork-based Snapshot Mechanism from the OS Level<br /> <br /> [EuroSys '21] On-demand-fork: a microsecond fork for memory-intensive and latency-sensitive applications</div>

Wenhuizhang https://criu.org/index.php?title=Academic_Research&diff=5570 Academic Research 2024-12-10T23:20:58Z

<p>Wenhuizhang: add 24 works</p> <hr /> <div>* GPU CRIU<br /> <br /> [SoCC'24] On-demand and Parallel Checkpoint/Restore for GPU Applications<br /> <br /> <br /> * CRIU for Migration<br /> <br /> [APNet'24] Software-based Live Migration for Containerized RDMA<br /> <br /> [SEATED'24] Live Migration of Multi-Container Kubernetes Pods in Multi-Cluster Serverless Edge Systems<br /> <br /> [ICT'24] Packet Buffering to Minimize Service Downtime and Packet Loss During Redundancy Switchover<br /> <br /> [ICDCS'24] Dapper: A Lightweight and Extensible Framework for Live Program State Rewriting<br /> <br /> [Cloud'24] FastMig: Leveraging FastFreeze to Establish Robust Service Liquidity in Cloud 2.0<br /> <br /> [TOCS'22] H-Container: Enabling Heterogeneous-ISA Container Migration in Edge Computing<br /> <br /> [VEE'22] Portkey: hypervisor-assisted container migration in nested cloud environments<br /> <br /> <br /> * CRIU Security<br /> <br /> [APSys'24] Towards Efficient End-to-End Encryption for Container Checkpointing Systems<br /> <br /> [eBPF'24] Custom Page Fault Handling With eBPF<br /> <br /> [ARES'24] Don't, Stop, Drop, Pause: Forensics of CONtainer CheckPOINTs (ConPoint)<br /> <br /> [ATC'22] RRC: Responsive Replicated Containers<br /> <br /> <br /> * CRIU for Database<br /> <br /> [Journal of Cloud Computing'24] MDB-KCP: persistence framework of in-memory database with CRIU-based container checkpoint in Kubernetes<br /> <br /> [VLDB'23] Async-fork: Mitigating Query Latency Spikes Incurred by the Fork-based Snapshot Mechanism from the OS Level<br /> <br /> [EuroSys'21] On-demand-fork: a microsecond fork for memory-intensive and latency-sensitive applications</div>

Wenhuizhang https://criu.org/index.php?title=Academic_Research&diff=5451 Academic Research 2024-01-23T23:09:51Z

<p>Wenhuizhang: </p> <hr /> <div><br /> * CRIU for Migration<br /> <br /> [TOCS'22] H-Container: Enabling Heterogeneous-ISA Container Migration in Edge Computing<br /> <br /> [VEE'22] Portkey: hypervisor-assisted container migration in nested cloud environments<br /> <br /> <br /> * CRIU for Security<br /> <br /> [ATC'22] RRC: Responsive Replicated Containers<br /> <br /> <br /> * CRIU for Database<br /> <br /> [VLDB'23] Async-fork: Mitigating Query Latency Spikes Incurred by the Fork-based Snapshot Mechanism from the OS Level<br /> <br /> [EuroSys'21] On-demand-fork: a microsecond fork for memory-intensive and latency-sensitive applications</div>

Wenhuizhang https://criu.org/index.php?title=Academic_Research&diff=5384 Academic Research 2023-03-11T01:40:42Z

<p>Wenhuizhang: </p> <hr /> <div><br /> * CRIU for Migration<br /> <br /> [VEE'22] Portkey: hypervisor-assisted container migration in nested cloud environments<br /> <br /> <br /> * CRIU for Security<br /> <br /> [ATC'22] RRC: Responsive Replicated Containers<br /> <br /> <br /> * CRIU for Database<br /> <br /> [VLDB'23] Async-fork: Mitigating Query Latency Spikes Incurred by the Fork-based Snapshot Mechanism from the OS Level<br /> <br /> [EuroSys'21] On-demand-fork: a microsecond fork for memory-intensive and latency-sensitive applications</div>

Wenhuizhang https://criu.org/index.php?title=Academic_Research&diff=5383 Academic Research 2023-03-11T01:36:46Z

<p>Wenhuizhang: Replaced content with "* Optimization of CRIU * CRIU for Migration [VEE'22] Portkey: hypervisor-assisted container migration in nested cloud environments * CRIU for Security [ATC'22] RRC..."</p> <hr /> <div>* Optimization of CRIU<br /> <br /> <br /> <br /> <br /> * CRIU for Migration<br /> <br /> [VEE'22] Portkey: hypervisor-assisted container migration in nested cloud environments<br /> <br /> <br /> * CRIU for Security<br /> <br /> [ATC'22] RRC: Responsive Replicated Containers<br /> <br /> <br /> * CRIU for Database<br /> <br /> [VLDB'23] Async-fork: Mitigating Query Latency Spikes Incurred by the Fork-based Snapshot Mechanism from the OS Level<br /> <br /> <br /> [EuroSys'21] On-demand-fork: a microsecond fork for memory-intensive and latency-sensitive applications</div>

Wenhuizhang https://criu.org/index.php?title=Academic_Research&diff=5382 Academic Research 2023-03-11T01:35:47Z

<p>Wenhuizhang: </p> <hr /> <div>* Optimization of CRIU<br /> <br /> <br /> <br /> <br /> * CRIU for Migration<br /> <br /> [VEE'22] Portkey: hypervisor-assisted container migration in nested cloud environments<br /> <br /> Abstract<br /> <br /> Derivative cloud service providers use nesting to provision virtual computational entities (VCE) within VCEs, e.g., containers runtimes within virtual machines. As part of resource management and ensuring application performance, migration of nested containers is an important and useful mechanism. Checkpoint Restore In Userspace (CRIU) is the dominant method for migration, used by Docker and other container technologies. While CRIU works well for container migration from host to host, it suffers from significant increase in resource requirements in nested setups. The overheads are primarily due to the high network virtualization overhead in nested environments. While techniques such as SR-IOV can mitigate the overheads, they require additional hardware features and tight coupling of network endpoints. Based on our insights of network virtualization being the main bottleneck, we present Portkey - a software-based solution for efficient nested container migration that significantly reduces CPU utilization at both the source and destination hosts. Our solution relies on interposing a layer that directly coordinates network IO from within a virtual machine with the hypervisor. A new set of hypercalls provide this interfacing along with a control loop that minimizes the hypercall path usage. Extensive evaluation of our solution shows that Portkey reduces CPU usage by up to 75% and 82% at the source and destination hosts, respectively.<br /> <br /> <br /> <br /> <br /> <br /> <br /> <br /> <br /> <br /> <br /> <br /> <br /> * CRIU for Security<br /> <br /> [ATC'22] RRC: Responsive Replicated Containers<br /> <br /> Abstract<br /> <br /> Replication is the basic mechanism for providing application-transparent reliability through fault tolerance. The design and implementation of replication mechanisms is particularly challenging for general multithreaded services, where high latency overhead is not acceptable. Most of the existing replication mechanisms fail to meet this challenge.<br /> RRC is a fully-operational fault tolerance mechanism for multiprocessor workloads, based on container replication. It minimizes the latency overhead during normal operation by addressing two key sources of this overhead: (1) it decouples the latency overhead from checkpointing frequency using a hybrid of checkpointing and replay, and (2) it minimizes the pause time for checkpointing by forking a clone of the container to be checkpointed, thus allowing execution to proceed in parallel with checkpointing. The fact that RRC is based on checkpointing makes it inherently less vulnerable to data races than active replication. In addition, RRC includes mechanisms that further reduce the vulnerability to data races, resulting in high recovery rates, as long as the rate of manifested data races is low. The evaluation includes measurement of the recovery rate and recovery latency based on thousands of fault injections. On average, RRC delays responses to clients by less than 400mu's and recovers in less than 1s. The average pause latency is less than 3.3ms. For a set of eight real-world benchmarks, if data races are eliminated, the performance overhead of RRC is under 48%.<br /> <br /> <br /> <br /> <br /> <br /> <br /> <br /> <br /> <br /> <br /> <br /> <br /> <br /> <br /> <br /> <br /> * CRIU for Database<br /> <br /> [VLDB'23] Async-fork: Mitigating Query Latency Spikes Incurred by the Fork-based Snapshot Mechanism from the OS Level<br /> <br /> Abstract<br /> <br /> In-memory key-value stores (IMKVSes) serve many online applications. They generally adopt the fork-based snapshot mechanism to support data backup. However, this method can result in query latency spikes because the engine is out-of-service for queries during the snapshot. In contrast to existing research optimizing snapshot algorithms, we address the problem from the operating system (OS) level, while keeping the data persistent mechanism in IMKVSes unchanged. Specifically, we first study the impact of the fork operation on query latency. Based on findings in the study, we propose Async-fork, which performs the fork operation asynchronously to reduce the out-of-service time of the engine. Async-fork is implemented in the Linux kernel and deployed into the online Redis database in public clouds. Our experiment results show that Async-fork can significantly reduce the tail latency of queries during the snapshot.<br /> <br /> <br /> [EuroSys'21] On-demand-fork: a microsecond fork for memory-intensive and latency-sensitive applications<br /> <br /> Abstract<br /> <br /> Fork has long been the process creation system call for Unix. At its inception, fork was hailed as an efficient system call due to its use of copy-on-write on memory shared between parent and child processes. However, application memory demand has increased drastically since the early days and the cost incurred by fork to simply set up virtual memory (e.g., copy page tables) is now a concern, even for applications that only require hundreds of MBs of memory. In practice, fork performance already holds back system efficiency and latency across a range of uses cases that fork large processes, such as fault-tolerant systems, serverless frameworks, and testing frameworks.<br /> This paper proposes On-demand-fork, a fast implementation of the fork system call specifically designed for applications with large memory footprints. On-demand-fork relies on the observation that copy-on-write can be generalized to page tables, even on commodity hardware. On-demand-fork executes faster than the traditional fork implementation by additionally sharing page tables between parent and child at fork time and selectively copying page tables in small chunks, on-demand, when handling page faults. On-demand-fork is a drop-in replacement for fork that requires no changes to applications or hardware.<br /> We evaluated On-demand-fork on a range of micro-benchmarks and real-world workloads. On-demand-fork significantly reduces the fork invocation time and has improved scalability. For processes with 1 GB of allocated memory, On-demand-fork has a 65× performance advantage over Fork. We also evaluated On-demand-fork on testing, fuzzing, and snapshotting workloads of well-known applications, obtaining execution throughput improvements between 59% and 226% and up to 99% invocation latency reduction.</div>

Wenhuizhang https://criu.org/index.php?title=Academic_Research&diff=5381 Academic Research 2023-03-11T01:15:18Z

<p>Wenhuizhang: </p> <hr /> <div>* Optimization of CRIU<br /> * CRIU for Migration<br /> * CRIU for Security<br /> * CRIU for Database<br /> <br /> [VLDB'23] Async-fork: Mitigating Query Latency Spikes Incurred by the Fork-based Snapshot Mechanism from the OS Level<br /> <br /> Abstract<br /> <br /> In-memory key-value stores (IMKVSes) serve many online applications. They generally adopt the fork-based snapshot mechanism to support data backup. However, this method can result in query latency spikes because the engine is out-of-service for queries during the snapshot. In contrast to existing research optimizing snapshot algorithms, we address the problem from the operating system (OS) level, while keeping the data persistent mechanism in IMKVSes unchanged. Specifically, we first study the impact of the fork operation on query latency. Based on findings in the study, we propose Async-fork, which performs the fork operation asynchronously to reduce the out-of-service time of the engine. Async-fork is implemented in the Linux kernel and deployed into the online Redis database in public clouds. Our experiment results show that Async-fork can significantly reduce the tail latency of queries during the snapshot.<br /> <br /> <br /> [EuroSys'21] On-demand-fork: a microsecond fork for memory-intensive and latency-sensitive applications<br /> <br /> Abstract<br /> <br /> Fork has long been the process creation system call for Unix. At its inception, fork was hailed as an efficient system call due to its use of copy-on-write on memory shared between parent and child processes. However, application memory demand has increased drastically since the early days and the cost incurred by fork to simply set up virtual memory (e.g., copy page tables) is now a concern, even for applications that only require hundreds of MBs of memory. In practice, fork performance already holds back system efficiency and latency across a range of uses cases that fork large processes, such as fault-tolerant systems, serverless frameworks, and testing frameworks.<br /> <br /> This paper proposes On-demand-fork, a fast implementation of the fork system call specifically designed for applications with large memory footprints. On-demand-fork relies on the observation that copy-on-write can be generalized to page tables, even on commodity hardware. On-demand-fork executes faster than the traditional fork implementation by additionally sharing page tables between parent and child at fork time and selectively copying page tables in small chunks, on-demand, when handling page faults. On-demand-fork is a drop-in replacement for fork that requires no changes to applications or hardware.<br /> <br /> We evaluated On-demand-fork on a range of micro-benchmarks and real-world workloads. On-demand-fork significantly reduces the fork invocation time and has improved scalability. For processes with 1 GB of allocated memory, On-demand-fork has a 65× performance advantage over Fork. We also evaluated On-demand-fork on testing, fuzzing, and snapshotting workloads of well-known applications, obtaining execution throughput improvements between 59% and 226% and up to 99% invocation latency reduction.</div>

Wenhuizhang https://criu.org/index.php?title=Academic_Research&diff=5380 Academic Research 2023-03-11T01:14:47Z

<p>Wenhuizhang: add two papers for fork</p> <hr /> <div>* Optimization of CRIU<br /> * CRIU for Migration<br /> * CRIU for Security<br /> * CRIU for Database<br /> <br /> [VLDB'23] Async-fork: Mitigating Query Latency Spikes Incurred by the Fork-based Snapshot Mechanism from the OS Level<br /> Abstract<br /> In-memory key-value stores (IMKVSes) serve many online applications. They generally adopt the fork-based snapshot mechanism to support data backup. However, this method can result in query latency spikes because the engine is out-of-service for queries during the snapshot. In contrast to existing research optimizing snapshot algorithms, we address the problem from the operating system (OS) level, while keeping the data persistent mechanism in IMKVSes unchanged. Specifically, we first study the impact of the fork operation on query latency. Based on findings in the study, we propose Async-fork, which performs the fork operation asynchronously to reduce the out-of-service time of the engine. Async-fork is implemented in the Linux kernel and deployed into the online Redis database in public clouds. Our experiment results show that Async-fork can significantly reduce the tail latency of queries during the snapshot.<br /> <br /> <br /> [EuroSys'21] On-demand-fork: a microsecond fork for memory-intensive and latency-sensitive applications<br /> ABSTRACT<br /> Fork has long been the process creation system call for Unix. At its inception, fork was hailed as an efficient system call due to its use of copy-on-write on memory shared between parent and child processes. However, application memory demand has increased drastically since the early days and the cost incurred by fork to simply set up virtual memory (e.g., copy page tables) is now a concern, even for applications that only require hundreds of MBs of memory. In practice, fork performance already holds back system efficiency and latency across a range of uses cases that fork large processes, such as fault-tolerant systems, serverless frameworks, and testing frameworks.<br /> <br /> This paper proposes On-demand-fork, a fast implementation of the fork system call specifically designed for applications with large memory footprints. On-demand-fork relies on the observation that copy-on-write can be generalized to page tables, even on commodity hardware. On-demand-fork executes faster than the traditional fork implementation by additionally sharing page tables between parent and child at fork time and selectively copying page tables in small chunks, on-demand, when handling page faults. On-demand-fork is a drop-in replacement for fork that requires no changes to applications or hardware.<br /> <br /> We evaluated On-demand-fork on a range of micro-benchmarks and real-world workloads. On-demand-fork significantly reduces the fork invocation time and has improved scalability. For processes with 1 GB of allocated memory, On-demand-fork has a 65× performance advantage over Fork. We also evaluated On-demand-fork on testing, fuzzing, and snapshotting workloads of well-known applications, obtaining execution throughput improvements between 59% and 226% and up to 99% invocation latency reduction.</div>

Wenhuizhang https://criu.org/index.php?title=Academic_Research&diff=5368 Academic Research 2023-02-26T03:49:39Z

<p>Wenhuizhang: Created page with "* Optimization of CRIU * CRIU for Migration * CRIU for Security * CRIU for Database"</p> <hr /> <div>* Optimization of CRIU<br /> * CRIU for Migration<br /> * CRIU for Security<br /> * CRIU for Database</div>

Wenhuizhang https://criu.org/index.php?title=Main_Page&diff=5367 Main Page 2023-02-26T03:49:04Z

<p>Wenhuizhang: </p> <hr /> <div><div style="float: {{{1|right}}}"><br /> {{Download box|left}}<br /> [[Image:3.17.jpg|right|340px]]<br /> </div><br /> __NOTOC__<br /> <big>Welcome to CRIU, a project to implement checkpoint/restore functionality for Linux.<br /> <br /> Checkpoint/Restore In Userspace, or CRIU (pronounced kree-oo, IPA: /krɪʊ/, Russian: криу), is a Linux software. It can freeze a running container (or an individual application) and checkpoint its state to disk. The data saved can be used to restore the application and run it exactly as it was during the time of the freeze. Using this functionality, application or container live migration, snapshots, remote debugging, and [[usage scenarios|many other things]] are now possible.<br /> <br /> CRIU started as a project of Virtuozzo, and grew with the tremendous help from the [[community]]. It is currently used by (integrated into) OpenVZ, [[LXC]]/LXD, [[Docker]], Podman, and [[Integration|other software]], and [[packages|packaged for many Linux distributions]].<br /> </big><br /> {{Like}}<br /> <br clear="both"><br /> <br /> <div class="m_right"><br /> {{News block 2}}<br /> </div><br /> <br /> <div class="m_left"><br /> == Using ==<br /> <br /> <big><br /> ;Getting [[packages]] for your distribution<br /> : Or try manual [[installation]] to have CRIU on your system<br /> </big><br /> <br /> ;[[CLI]], [[RPC]] and [[C API]]<br /> : Three ways to start using the C/R functionality. [[:Category:API|More info]] about APIs.<br /> <br /> ;[[Usage scenarios]]<br /> : Ideas how criu can be used (some are crazy indeed)<br /> <br /> ;[[:Category:HOWTO]]<br /> : Collection of real world examples of how to use CRIU. Some are complex, some are not. HOW TO dump a [[simple loop]] might be the best one to start with. Also a set of [[asciinema]] records for real-life examples.<br /> <br /> ;[[FAQ]] & [[When C/R fails]]<br /> : A sort of troubleshooting guide<br /> <br /> ;[[What can change after C/R]]<br /> : CRIU cannot (yet) save and restore every single bit of tasks' state. This page describes what bits visible through standard kernel API are such.<br /> <br /> ;[[What cannot be checkpointed]]<br /> : What an application could do to make CRIU refuse to dump it.<br /> <br /> ;[[Contacts]]<br /> : Ways to communicate with CRIU community<br /> <br /> </div><br /> <br /> <div class="m_center"><br /> == Developing ==<br /> If you're interested in CRIU development, please subscribe to the criu mailing list: https://lists.openvz.org/mailman/listinfo/criu<br /> <br /> ;[[Images]]<br /> : Description of image files format<br /> <br /> ;[[Plugins]]<br /> : CRIU can call plugins provided by people<br /> <br /> ;[[Upstream kernel commits]]<br /> : Mainline kernel commits tracker<br /> <br /> ;[[Recent commits]]<br /> : CRIU tool repository commits<br /> <br /> ;[[Manpages]]<br /> : Kernel's manpages commits tracker<br /> <br /> ;[[ZDTM Test Suite]]<br /> : Zero downtime test suite<br /> <br /> ;[[Todo|TODO]]<br /> : Current TODO list<br /> <br /> ;[[User namespace]]<br /> : Implementing user namespace support<br /> <br /> ;[[Postulates]]<br /> : What to keep in mind when writing new code<br /> <br /> ;[https://coveralls.io/github/checkpoint-restore/criu Code coverage results]<br /> : Shows how zdtm run covers the criu code paths<br /> <br /> ;[[How to submit patches]]<br /> :<br /> <br /> </div><br /> <br /> <br clear="both"><br /> <div class="m_left"><br /> == Under the hood ==<br /> * [[Checkpoint/Restore]]<br /> * [[:Category:Under the hood]]<br /> * [[:Category:Network]]<br /> * [[:Category:Files]]<br /> * [[:Category:Memory]]<br /> * [[Pending signals]]<br /> * [[Stages of restoring]]<br /> * [[Code blobs]]<br /> * [[Comparison to other CR projects]]<br /> </div><br /> <br /> <div class="m_center"><br /> == External links ==<br /> {{:Articles}}<br /> </div><br /> <br /> <div class="m_center"><br /> == Academic Research ==<br /> {{:Academic Research}}<br /> </div><br /> <br /> <div class="m_right"><br /> == Misc ==<br /> * [[Podcasts]] and other audio/video interviews<br /> * Project [[history]]<br /> * [[Logo]] description<br /> * [[Events]]<br /> * [[CRIU acronym fun]]<br /> </div></div>

Wenhuizhang https://criu.org/index.php?title=User_talk:Wenhuizhang&diff=5366 User talk:Wenhuizhang 2023-02-26T03:45:39Z

<p>Wenhuizhang: </p> <hr /> <div>* Optimization of CRIU<br /> <br /> * CRIU for Migration<br /> <br /> * CRIU for Security<br /> <br /> * CRIU for Database</div>

Wenhuizhang https://criu.org/index.php?title=Main_Page&diff=5365 Main Page 2023-02-26T03:44:33Z

<p>Wenhuizhang: </p> <hr /> <div><div style="float: {{{1|right}}}"><br /> {{Download box|left}}<br /> [[Image:3.17.jpg|right|340px]]<br /> </div><br /> __NOTOC__<br /> <big>Welcome to CRIU, a project to implement checkpoint/restore functionality for Linux.<br /> <br /> Checkpoint/Restore In Userspace, or CRIU (pronounced kree-oo, IPA: /krɪʊ/, Russian: криу), is a Linux software. It can freeze a running container (or an individual application) and checkpoint its state to disk. The data saved can be used to restore the application and run it exactly as it was during the time of the freeze. Using this functionality, application or container live migration, snapshots, remote debugging, and [[usage scenarios|many other things]] are now possible.<br /> <br /> CRIU started as a project of Virtuozzo, and grew with the tremendous help from the [[community]]. It is currently used by (integrated into) OpenVZ, [[LXC]]/LXD, [[Docker]], Podman, and [[Integration|other software]], and [[packages|packaged for many Linux distributions]].<br /> </big><br /> {{Like}}<br /> <br clear="both"><br /> <br /> <div class="m_right"><br /> {{News block 2}}<br /> </div><br /> <br /> <div class="m_left"><br /> == Using ==<br /> <br /> <big><br /> ;Getting [[packages]] for your distribution<br /> : Or try manual [[installation]] to have CRIU on your system<br /> </big><br /> <br /> ;[[CLI]], [[RPC]] and [[C API]]<br /> : Three ways to start using the C/R functionality. [[:Category:API|More info]] about APIs.<br /> <br /> ;[[Usage scenarios]]<br /> : Ideas how criu can be used (some are crazy indeed)<br /> <br /> ;[[:Category:HOWTO]]<br /> : Collection of real world examples of how to use CRIU. Some are complex, some are not. HOW TO dump a [[simple loop]] might be the best one to start with. Also a set of [[asciinema]] records for real-life examples.<br /> <br /> ;[[FAQ]] & [[When C/R fails]]<br /> : A sort of troubleshooting guide<br /> <br /> ;[[What can change after C/R]]<br /> : CRIU cannot (yet) save and restore every single bit of tasks' state. This page describes what bits visible through standard kernel API are such.<br /> <br /> ;[[What cannot be checkpointed]]<br /> : What an application could do to make CRIU refuse to dump it.<br /> <br /> ;[[Contacts]]<br /> : Ways to communicate with CRIU community<br /> <br /> </div><br /> <br /> <div class="m_center"><br /> == Developing ==<br /> If you're interested in CRIU development, please subscribe to the criu mailing list: https://lists.openvz.org/mailman/listinfo/criu<br /> <br /> ;[[Images]]<br /> : Description of image files format<br /> <br /> ;[[Plugins]]<br /> : CRIU can call plugins provided by people<br /> <br /> ;[[Upstream kernel commits]]<br /> : Mainline kernel commits tracker<br /> <br /> ;[[Recent commits]]<br /> : CRIU tool repository commits<br /> <br /> ;[[Manpages]]<br /> : Kernel's manpages commits tracker<br /> <br /> ;[[ZDTM Test Suite]]<br /> : Zero downtime test suite<br /> <br /> ;[[Todo|TODO]]<br /> : Current TODO list<br /> <br /> ;[[User namespace]]<br /> : Implementing user namespace support<br /> <br /> ;[[Postulates]]<br /> : What to keep in mind when writing new code<br /> <br /> ;[https://coveralls.io/github/checkpoint-restore/criu Code coverage results]<br /> : Shows how zdtm run covers the criu code paths<br /> <br /> ;[[How to submit patches]]<br /> :<br /> <br /> </div><br /> <br /> <br clear="both"><br /> <div class="m_left"><br /> == Under the hood ==<br /> * [[Checkpoint/Restore]]<br /> * [[:Category:Under the hood]]<br /> * [[:Category:Network]]<br /> * [[:Category:Files]]<br /> * [[:Category:Memory]]<br /> * [[Pending signals]]<br /> * [[Stages of restoring]]<br /> * [[Code blobs]]<br /> * [[Comparison to other CR projects]]<br /> </div><br /> <br /> <div class="m_center"><br /> == External links ==<br /> {{:Articles}}<br /> </div><br /> <br /> <div class="m_center"><br /> == Academic Research ==<br /> {{:User talk:Wenhuizhang}}<br /> </div><br /> <br /> <div class="m_right"><br /> == Misc ==<br /> * [[Podcasts]] and other audio/video interviews<br /> * Project [[history]]<br /> * [[Logo]] description<br /> * [[Events]]<br /> * [[CRIU acronym fun]]<br /> </div></div>

Wenhuizhang https://criu.org/index.php?title=User_talk:Wenhuizhang&diff=5364 User talk:Wenhuizhang 2023-02-26T03:43:40Z

<p>Wenhuizhang: Created page with "Academic XXX User talk:Wenhuizhang"</p> <hr /> <div>Academic XXX<br /> User talk:Wenhuizhang</div>

Wenhuizhang https://criu.org/index.php?title=Main_Page&diff=5363 Main Page 2023-02-26T03:38:13Z

<p>Wenhuizhang: Add structure of Academic Research</p> <hr /> <div><div style="float: {{{1|right}}}"><br /> {{Download box|left}}<br /> [[Image:3.17.jpg|right|340px]]<br /> </div><br /> __NOTOC__<br /> <big>Welcome to CRIU, a project to implement checkpoint/restore functionality for Linux.<br /> <br /> Checkpoint/Restore In Userspace, or CRIU (pronounced kree-oo, IPA: /krɪʊ/, Russian: криу), is a Linux software. It can freeze a running container (or an individual application) and checkpoint its state to disk. The data saved can be used to restore the application and run it exactly as it was during the time of the freeze. Using this functionality, application or container live migration, snapshots, remote debugging, and [[usage scenarios|many other things]] are now possible.<br /> <br /> CRIU started as a project of Virtuozzo, and grew with the tremendous help from the [[community]]. It is currently used by (integrated into) OpenVZ, [[LXC]]/LXD, [[Docker]], Podman, and [[Integration|other software]], and [[packages|packaged for many Linux distributions]].<br /> </big><br /> {{Like}}<br /> <br clear="both"><br /> <br /> <div class="m_right"><br /> {{News block 2}}<br /> </div><br /> <br /> <div class="m_left"><br /> == Using ==<br /> <br /> <big><br /> ;Getting [[packages]] for your distribution<br /> : Or try manual [[installation]] to have CRIU on your system<br /> </big><br /> <br /> ;[[CLI]], [[RPC]] and [[C API]]<br /> : Three ways to start using the C/R functionality. [[:Category:API|More info]] about APIs.<br /> <br /> ;[[Usage scenarios]]<br /> : Ideas how criu can be used (some are crazy indeed)<br /> <br /> ;[[:Category:HOWTO]]<br /> : Collection of real world examples of how to use CRIU. Some are complex, some are not. HOW TO dump a [[simple loop]] might be the best one to start with. Also a set of [[asciinema]] records for real-life examples.<br /> <br /> ;[[FAQ]] & [[When C/R fails]]<br /> : A sort of troubleshooting guide<br /> <br /> ;[[What can change after C/R]]<br /> : CRIU cannot (yet) save and restore every single bit of tasks' state. This page describes what bits visible through standard kernel API are such.<br /> <br /> ;[[What cannot be checkpointed]]<br /> : What an application could do to make CRIU refuse to dump it.<br /> <br /> ;[[Contacts]]<br /> : Ways to communicate with CRIU community<br /> <br /> </div><br /> <br /> <div class="m_center"><br /> == Developing ==<br /> If you're interested in CRIU development, please subscribe to the criu mailing list: https://lists.openvz.org/mailman/listinfo/criu<br /> <br /> ;[[Images]]<br /> : Description of image files format<br /> <br /> ;[[Plugins]]<br /> : CRIU can call plugins provided by people<br /> <br /> ;[[Upstream kernel commits]]<br /> : Mainline kernel commits tracker<br /> <br /> ;[[Recent commits]]<br /> : CRIU tool repository commits<br /> <br /> ;[[Manpages]]<br /> : Kernel's manpages commits tracker<br /> <br /> ;[[ZDTM Test Suite]]<br /> : Zero downtime test suite<br /> <br /> ;[[Todo|TODO]]<br /> : Current TODO list<br /> <br /> ;[[User namespace]]<br /> : Implementing user namespace support<br /> <br /> ;[[Postulates]]<br /> : What to keep in mind when writing new code<br /> <br /> ;[https://coveralls.io/github/checkpoint-restore/criu Code coverage results]<br /> : Shows how zdtm run covers the criu code paths<br /> <br /> ;[[How to submit patches]]<br /> :<br /> <br /> </div><br /> <br /> <br clear="both"><br /> <div class="m_left"><br /> == Under the hood ==<br /> * [[Checkpoint/Restore]]<br /> * [[:Category:Under the hood]]<br /> * [[:Category:Network]]<br /> * [[:Category:Files]]<br /> * [[:Category:Memory]]<br /> * [[Pending signals]]<br /> * [[Stages of restoring]]<br /> * [[Code blobs]]<br /> * [[Comparison to other CR projects]]<br /> </div><br /> <br /> <div class="m_center"><br /> == External links ==<br /> {{:Articles}}<br /> </div><br /> <br /> <div class="m_center"><br /> == Academic Research ==<br /> * [[Optimization of CRIU]]<br /> * [[CRIU for Migration]]<br /> * [[CRIU for Security]]<br /> * [[CRIU for Database]]<br /> </div><br /> <br /> <div class="m_right"><br /> == Misc ==<br /> * [[Podcasts]] and other audio/video interviews<br /> * Project [[history]]<br /> * [[Logo]] description<br /> * [[Events]]<br /> * [[CRIU acronym fun]]<br /> </div></div>

Wenhuizhang https://criu.org/index.php?title=Main_Page&diff=5362 Main Page 2023-02-26T03:35:20Z

<p>Wenhuizhang: </p> <hr /> <div><div style="float: {{{1|right}}}"><br /> {{Download box|left}}<br /> [[Image:3.17.jpg|right|340px]]<br /> </div><br /> __NOTOC__<br /> <big>Welcome to CRIU, a project to implement checkpoint/restore functionality for Linux.<br /> <br /> Checkpoint/Restore In Userspace, or CRIU (pronounced kree-oo, IPA: /krɪʊ/, Russian: криу), is a Linux software. It can freeze a running container (or an individual application) and checkpoint its state to disk. The data saved can be used to restore the application and run it exactly as it was during the time of the freeze. Using this functionality, application or container live migration, snapshots, remote debugging, and [[usage scenarios|many other things]] are now possible.<br /> <br /> CRIU started as a project of Virtuozzo, and grew with the tremendous help from the [[community]]. It is currently used by (integrated into) OpenVZ, [[LXC]]/LXD, [[Docker]], Podman, and [[Integration|other software]], and [[packages|packaged for many Linux distributions]].<br /> </big><br /> {{Like}}<br /> <br clear="both"><br /> <br /> <div class="m_right"><br /> {{News block 2}}<br /> </div><br /> <br /> <div class="m_left"><br /> == Using ==<br /> <br /> <big><br /> ;Getting [[packages]] for your distribution<br /> : Or try manual [[installation]] to have CRIU on your system<br /> </big><br /> <br /> ;[[CLI]], [[RPC]] and [[C API]]<br /> : Three ways to start using the C/R functionality. [[:Category:API|More info]] about APIs.<br /> <br /> ;[[Usage scenarios]]<br /> : Ideas how criu can be used (some are crazy indeed)<br /> <br /> ;[[:Category:HOWTO]]<br /> : Collection of real world examples of how to use CRIU. Some are complex, some are not. HOW TO dump a [[simple loop]] might be the best one to start with. Also a set of [[asciinema]] records for real-life examples.<br /> <br /> ;[[FAQ]] & [[When C/R fails]]<br /> : A sort of troubleshooting guide<br /> <br /> ;[[What can change after C/R]]<br /> : CRIU cannot (yet) save and restore every single bit of tasks' state. This page describes what bits visible through standard kernel API are such.<br /> <br /> ;[[What cannot be checkpointed]]<br /> : What an application could do to make CRIU refuse to dump it.<br /> <br /> ;[[Contacts]]<br /> : Ways to communicate with CRIU community<br /> <br /> </div><br /> <br /> <div class="m_center"><br /> == Developing ==<br /> If you're interested in CRIU development, please subscribe to the criu mailing list: https://lists.openvz.org/mailman/listinfo/criu<br /> <br /> ;[[Images]]<br /> : Description of image files format<br /> <br /> ;[[Plugins]]<br /> : CRIU can call plugins provided by people<br /> <br /> ;[[Upstream kernel commits]]<br /> : Mainline kernel commits tracker<br /> <br /> ;[[Recent commits]]<br /> : CRIU tool repository commits<br /> <br /> ;[[Manpages]]<br /> : Kernel's manpages commits tracker<br /> <br /> ;[[ZDTM Test Suite]]<br /> : Zero downtime test suite<br /> <br /> ;[[Todo|TODO]]<br /> : Current TODO list<br /> <br /> ;[[User namespace]]<br /> : Implementing user namespace support<br /> <br /> ;[[Postulates]]<br /> : What to keep in mind when writing new code<br /> <br /> ;[https://coveralls.io/github/checkpoint-restore/criu Code coverage results]<br /> : Shows how zdtm run covers the criu code paths<br /> <br /> ;[[How to submit patches]]<br /> :<br /> <br /> </div><br /> <br /> <br clear="both"><br /> <div class="m_left"><br /> == Under the hood ==<br /> * [[Checkpoint/Restore]]<br /> * [[:Category:Under the hood]]<br /> * [[:Category:Network]]<br /> * [[:Category:Files]]<br /> * [[:Category:Memory]]<br /> * [[Pending signals]]<br /> * [[Stages of restoring]]<br /> * [[Code blobs]]<br /> * [[Comparison to other CR projects]]<br /> </div><br /> <br /> <div class="m_center"><br /> == External links ==<br /> {{:Articles}}<br /> </div><br /> <br /> <div class="m_center"><br /> == Academic Research ==<br /> {{:Optimization of CRIU}}<br /> {{:CRIU for Migration}}<br /> {{:CRIU for Security}}<br /> {{:CRIU for Database}}<br /> </div><br /> <br /> <div class="m_right"><br /> == Misc ==<br /> * [[Podcasts]] and other audio/video interviews<br /> * Project [[history]]<br /> * [[Logo]] description<br /> * [[Events]]<br /> * [[CRIU acronym fun]]<br /> </div></div>

Wenhuizhang https://criu.org/index.php?title=Main_Page&diff=5361 Main Page 2023-02-26T03:31:11Z

<p>Wenhuizhang: </p> <hr /> <div><div style="float: {{{1|right}}}"><br /> {{Download box|left}}<br /> [[Image:3.17.jpg|right|340px]]<br /> </div><br /> __NOTOC__<br /> <big>Welcome to CRIU, a project to implement checkpoint/restore functionality for Linux.<br /> <br /> Checkpoint/Restore In Userspace, or CRIU (pronounced kree-oo, IPA: /krɪʊ/, Russian: криу), is a Linux software. It can freeze a running container (or an individual application) and checkpoint its state to disk. The data saved can be used to restore the application and run it exactly as it was during the time of the freeze. Using this functionality, application or container live migration, snapshots, remote debugging, and [[usage scenarios|many other things]] are now possible.<br /> <br /> CRIU started as a project of Virtuozzo, and grew with the tremendous help from the [[community]]. It is currently used by (integrated into) OpenVZ, [[LXC]]/LXD, [[Docker]], Podman, and [[Integration|other software]], and [[packages|packaged for many Linux distributions]].<br /> </big><br /> {{Like}}<br /> <br clear="both"><br /> <br /> <div class="m_right"><br /> {{News block 2}}<br /> </div><br /> <br /> <div class="m_left"><br /> == Using ==<br /> <br /> <big><br /> ;Getting [[packages]] for your distribution<br /> : Or try manual [[installation]] to have CRIU on your system<br /> </big><br /> <br /> ;[[CLI]], [[RPC]] and [[C API]]<br /> : Three ways to start using the C/R functionality. [[:Category:API|More info]] about APIs.<br /> <br /> ;[[Usage scenarios]]<br /> : Ideas how criu can be used (some are crazy indeed)<br /> <br /> ;[[:Category:HOWTO]]<br /> : Collection of real world examples of how to use CRIU. Some are complex, some are not. HOW TO dump a [[simple loop]] might be the best one to start with. Also a set of [[asciinema]] records for real-life examples.<br /> <br /> ;[[FAQ]] & [[When C/R fails]]<br /> : A sort of troubleshooting guide<br /> <br /> ;[[What can change after C/R]]<br /> : CRIU cannot (yet) save and restore every single bit of tasks' state. This page describes what bits visible through standard kernel API are such.<br /> <br /> ;[[What cannot be checkpointed]]<br /> : What an application could do to make CRIU refuse to dump it.<br /> <br /> ;[[Contacts]]<br /> : Ways to communicate with CRIU community<br /> <br /> </div><br /> <br /> <div class="m_center"><br /> == Developing ==<br /> If you're interested in CRIU development, please subscribe to the criu mailing list: https://lists.openvz.org/mailman/listinfo/criu<br /> <br /> ;[[Images]]<br /> : Description of image files format<br /> <br /> ;[[Plugins]]<br /> : CRIU can call plugins provided by people<br /> <br /> ;[[Upstream kernel commits]]<br /> : Mainline kernel commits tracker<br /> <br /> ;[[Recent commits]]<br /> : CRIU tool repository commits<br /> <br /> ;[[Manpages]]<br /> : Kernel's manpages commits tracker<br /> <br /> ;[[ZDTM Test Suite]]<br /> : Zero downtime test suite<br /> <br /> ;[[Todo|TODO]]<br /> : Current TODO list<br /> <br /> ;[[User namespace]]<br /> : Implementing user namespace support<br /> <br /> ;[[Postulates]]<br /> : What to keep in mind when writing new code<br /> <br /> ;[https://coveralls.io/github/checkpoint-restore/criu Code coverage results]<br /> : Shows how zdtm run covers the criu code paths<br /> <br /> ;[[How to submit patches]]<br /> :<br /> <br /> </div><br /> <br /> <br clear="both"><br /> <div class="m_left"><br /> == Under the hood ==<br /> * [[Checkpoint/Restore]]<br /> * [[:Category:Under the hood]]<br /> * [[:Category:Network]]<br /> * [[:Category:Files]]<br /> * [[:Category:Memory]]<br /> * [[Pending signals]]<br /> * [[Stages of restoring]]<br /> * [[Code blobs]]<br /> * [[Comparison to other CR projects]]<br /> </div><br /> <br /> <div class="m_center"><br /> == External links ==<br /> {{:Articles}}<br /> </div><br /> <br /> <div class="m_center"><br /> == External links ==<br /> {{:Acedemic Research}}<br /> </div><br /> <br /> <div class="m_right"><br /> == Misc ==<br /> * [[Podcasts]] and other audio/video interviews<br /> * Project [[history]]<br /> * [[Logo]] description<br /> * [[Events]]<br /> * [[CRIU acronym fun]]<br /> </div></div>

Wenhuizhang https://criu.org/index.php?title=Performance_research&diff=5347 Performance research 2023-02-22T21:18:26Z

<p>Wenhuizhang: typo correction</p> <hr /> <div>Written here are performance issues found.<br /> <br /> Timing stats of live migration of a small container with 11 tasks is<br /> <br /> * Total time ~3.5 seconds<br /> * Frozen time ~3.0 seconds<br /> ** Pre-dump stages ~0.5 seconds each<br /> ** Restore time ~1.9 seconds<br /> ** Images transfer time ~0.3 seconds<br /> <br /> Below is the list of issues found<br /> <br /> == Dump ==<br /> <br /> Surprisingly, but the mem-drain time is not the biggest. It's "only" ~0.02 seconds. There are places in code that take longer.<br /> <br /> === <code>parse_smaps</code> ===<br /> <br /> Time spent in this routine is up to 0.2 seconds on dump. This one exploits /proc heavily. For a container with 11 tasks the syscall stats look like<br /> <br /> 834 read<br /> 1451 fstat<br /> 1462 close<br /> 1642 openat<br /> <br /> while opens and stats happen on<br /> <br /> 193 openat(4, "map-symlink", O_RDONLY) = -1 ENOENT (No such file or directory)<br /> 1438 openat(4, "map-symlink", O_RDONLY) = 5<br /> 11 openat(AT_FDCWD, "/proc/$pid/map_files", O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = 4<br /> <br /> == Restore ==<br /> <br /> === Fork vs VMA restore ===<br /> <br /> We restore task's mappings before it goes forking to handle COW. This effectively serializes forking.<br /> <br /> === Restoring VMAs ===<br /> <br /> There are 4 stages in VMA restore. Relative times of each are below<br /> <br /> * Reading images 1%<br /> * Mapping huge premap area << 1%<br /> * (Re-)mapping sub-areas 73%<br /> * Filling area with data 26%<br /> <br /> The 3rd stage has two parts. With timings:<br /> <br /> * Opening filemap fd 85%<br /> * Maping vma 15%<br /> <br /> <br /> === Opening files for mappings ===<br /> <br /> The <code>get_filemap_fd()</code> opens new fd every time. If a file is mapped several<br /> times (e.g. -- a library) we can share one fd for that.<br /> <br /> === Staging ===<br /> <br /> When restoring a single task CRIU uses [[stages of restoring]] which slows things down. Need either special-care the single task restore, or introduce fine-grained locking for such things.<br /> <br /> [[Category: Development]]<br /> [[Category: Thinkers]]</div>

Wenhuizhang