From d82e0373658f16f020b6f2ff23791a07910f46ac Mon Sep 17 00:00:00 2001 From: Jungnerd <46880056+jungnerd@users.noreply.github.com> Date: Thu, 30 May 2024 18:51:09 +0900 Subject: [PATCH 1/5] Update introduction-to-video.mdx added video processing part --- .../introduction-to-video.mdx | 32 +++++++++++++++++++ 1 file changed, 32 insertions(+) diff --git a/chapters/en/unit7/video-processing/introduction-to-video.mdx b/chapters/en/unit7/video-processing/introduction-to-video.mdx index 9a9f95d86..edcc9c320 100644 --- a/chapters/en/unit7/video-processing/introduction-to-video.mdx +++ b/chapters/en/unit7/video-processing/introduction-to-video.mdx @@ -36,3 +36,35 @@ Codecs, short for “compressor-decompressor” are software or hardware compone There are two main types of codecs; "lossless codecs" and "lossy codecs". Lossless codecs are designed to compress data without any loss of quality, while lossy codecs are more designed to compress by removing some of the data resulting in a loss of quality. In summary, a video is a dynamic multimedia format that combines a series of individual frames, audio, and often additional metadata. It is used in a wide range of applications and can be tailored for different purposes, whether for entertainment, education, communication, or analysis. + +## What is Video Processing? + +In the research field of computer vision (CV) and artificial intelligence (AI), video processing is all about automatically analyzing video data to understand and interpret both temporal and spatial features. Video data is simply a sequence of time-varying images, where the information is digitized both spatially and temporally. This allows us to perform detailed analysis and manipulation of the content within each frame of the video. + +Video processing has become increasingly important in today's technology-driven world, thanks to the rapid advancements in deep learning (DL) and AI. Traditionally, DL research has focused on images, speech, and text, but video data offers a unique and valuable opportunity for research due to its extensive size and complexity. With millions of videos uploaded daily on platforms like YouTube, video data has become a rich resource, driving AI research and enabling groundbreaking applications. + +### Applications of Video Processing + +- **Surveillance Systems:** +Video processing plays a critical role in public safety, crime prevention, and traffic monitoring. It enables the automated detection of suspicious activities, helps identify individuals, and enhances the efficiency of surveillance systems. + +- **Autonomous Driving:** +In the realm of autonomous driving, video processing is essential for navigation, obstacle detection, and decision-making processes. It allows self-driving cars to understand their surroundings, recognize road signs, and react to changing environments, ensuring safe and efficient transportation. + +- **Healthcare:** +Video processing has significant applications in healthcare, including medical diagnostics, surgery, and patient monitoring. It helps analyze medical images, provides real-time feedback during surgical procedures, and continuously monitors patients to detect any abnormalities or emergencies. + +### Challenges in Video Processing + +- **Computational Demands:** +Real-time video analysis requires substantial processing power, which poses a significant challenge in developing and deploying efficient video processing systems. High-performance computing resources are essential to meet these demands. + +- **Storage Requirements:** +High-resolution videos generate large volumes of data, leading to storage challenges. Efficient data compression and management techniques are necessary to handle the vast amounts of video data. + +- **Privacy and Ethical Concerns:** +Video processing, especially in surveillance and healthcare, involves handling sensitive information. Ensuring privacy and addressing ethical concerns related to the misuse of video data are crucial considerations that must be carefully managed. + +## Conclusion + +Video processing is a dynamic and vital area within AI and CV, offering numerous applications and presenting unique challenges. Its importance in modern technology continues to grow, fueled by advancements in deep learning and the increasing availability of video data. In the following sections, we will dive deeper into the deep learning for video processing. You'll explore state-of-the-art models including 3D CNNs and transformers. Additionally, we'll cover various tasks such as object tracking, action recognition, video stabilization, captioning, summarization, and background subtraction. These topics will provide you with a comprehensive understanding of how deep learning models are applied to different video processing challenges and applications. From d9211f5fc0cba8a0b1c781de01f3d65e173b36f5 Mon Sep 17 00:00:00 2001 From: Jungnerd <46880056+jungnerd@users.noreply.github.com> Date: Thu, 30 May 2024 18:53:56 +0900 Subject: [PATCH 2/5] Update introduction-to-video.mdx --- .../en/unit7/video-processing/introduction-to-video.mdx | 8 +++++--- 1 file changed, 5 insertions(+), 3 deletions(-) diff --git a/chapters/en/unit7/video-processing/introduction-to-video.mdx b/chapters/en/unit7/video-processing/introduction-to-video.mdx index edcc9c320..637b54e78 100644 --- a/chapters/en/unit7/video-processing/introduction-to-video.mdx +++ b/chapters/en/unit7/video-processing/introduction-to-video.mdx @@ -5,8 +5,6 @@ Of course, the real world of Computer Vision has a lot more to offer. Videos are Given their importance in our society and research, we also want to talk about them here in our course. In this introduction chapter, you will learn some very basic theory behind videos before going on to have a closer look at video processing. -Let's go! 🤓 - ## What is a Video? An image is a binary, two-dimensional (2D) representation of visual data. A video is a multimedia format that sequentially displays these frames or images. @@ -67,4 +65,8 @@ Video processing, especially in surveillance and healthcare, involves handling s ## Conclusion -Video processing is a dynamic and vital area within AI and CV, offering numerous applications and presenting unique challenges. Its importance in modern technology continues to grow, fueled by advancements in deep learning and the increasing availability of video data. In the following sections, we will dive deeper into the deep learning for video processing. You'll explore state-of-the-art models including 3D CNNs and transformers. Additionally, we'll cover various tasks such as object tracking, action recognition, video stabilization, captioning, summarization, and background subtraction. These topics will provide you with a comprehensive understanding of how deep learning models are applied to different video processing challenges and applications. +Video processing is a dynamic and vital area within AI and CV, offering numerous applications and presenting unique challenges. Its importance in modern technology continues to grow, fueled by advancements in deep learning and the increasing availability of video data. In the following sections, we will dive deeper into the deep learning for video processing. You'll explore state-of-the-art models including 3D CNNs and transformers. + +Additionally, we'll cover various tasks such as object tracking, action recognition, video stabilization, captioning, summarization, and background subtraction. These topics will provide you with a comprehensive understanding of how deep learning models are applied to different video processing challenges and applications. + +Let's go! 🤓 From 0c1da84f0b0bf6a646d7b33ecf91abb3cc4c8d1d Mon Sep 17 00:00:00 2001 From: Woojun Jung <46880056+jungnerd@users.noreply.github.com> Date: Tue, 18 Jun 2024 11:46:10 +0900 Subject: [PATCH 3/5] Added credits as a writer --- chapters/en/unit0/welcome/welcome.mdx | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/chapters/en/unit0/welcome/welcome.mdx b/chapters/en/unit0/welcome/welcome.mdx index 21a73e5b2..58e0020c6 100644 --- a/chapters/en/unit0/welcome/welcome.mdx +++ b/chapters/en/unit0/welcome/welcome.mdx @@ -125,7 +125,7 @@ Our goal was to create a computer vision course that is beginner-friendly and th **Unit 7 - Video and Video Processing** - Reviewers: [Ameed Taylor](https://github.com/atayloraerospace) -- Writers: [Diwakar Basnet](https://github.com/DiwakarBasnet) +- Writers: [Diwakar Basnet](https://github.com/DiwakarBasnet), [Woojun Jung](https://github.com/jungnerd) **Unit 8 - 3D Vision, Scene Rendering, and Reconstruction** From 475d3ffe0372294341881af49f25ee60f0890947 Mon Sep 17 00:00:00 2001 From: Woojun Jung <46880056+jungnerd@users.noreply.github.com> Date: Thu, 20 Jun 2024 10:00:57 +0900 Subject: [PATCH 4/5] Apply suggestions from code review Co-authored-by: A Taylor <112668339+ATaylorAerospace@users.noreply.github.com> --- .../en/unit7/video-processing/introduction-to-video.mdx | 6 ++++-- 1 file changed, 4 insertions(+), 2 deletions(-) diff --git a/chapters/en/unit7/video-processing/introduction-to-video.mdx b/chapters/en/unit7/video-processing/introduction-to-video.mdx index 637b54e78..bec44c34f 100644 --- a/chapters/en/unit7/video-processing/introduction-to-video.mdx +++ b/chapters/en/unit7/video-processing/introduction-to-video.mdx @@ -37,7 +37,8 @@ In summary, a video is a dynamic multimedia format that combines a series of ind ## What is Video Processing? -In the research field of computer vision (CV) and artificial intelligence (AI), video processing is all about automatically analyzing video data to understand and interpret both temporal and spatial features. Video data is simply a sequence of time-varying images, where the information is digitized both spatially and temporally. This allows us to perform detailed analysis and manipulation of the content within each frame of the video. +In the research field of computer vision (CV) and artificial intelligence (AI), video processing involves automatically analyzing video data to understand and interpret both temporal and spatial features. Video data is simply a sequence of time-varying images, where the information is digitized both spatially and temporally. This allows us to perform detailed analysis and manipulation of the content within each frame of the video. + Video processing has become increasingly important in today's technology-driven world, thanks to the rapid advancements in deep learning (DL) and AI. Traditionally, DL research has focused on images, speech, and text, but video data offers a unique and valuable opportunity for research due to its extensive size and complexity. With millions of videos uploaded daily on platforms like YouTube, video data has become a rich resource, driving AI research and enabling groundbreaking applications. @@ -65,7 +66,8 @@ Video processing, especially in surveillance and healthcare, involves handling s ## Conclusion -Video processing is a dynamic and vital area within AI and CV, offering numerous applications and presenting unique challenges. Its importance in modern technology continues to grow, fueled by advancements in deep learning and the increasing availability of video data. In the following sections, we will dive deeper into the deep learning for video processing. You'll explore state-of-the-art models including 3D CNNs and transformers. +Video processing is a dynamic and vital area within AI and CV, offering numerous applications and presenting unique challenges. Its importance in modern technology continues to grow, fueled by advancements in deep learning and the increasing availability of video data. In the following sections, we will dive deeper into deep learning for video processing. You'll explore state-of-the-art models including 3D CNNs and transformers. + Additionally, we'll cover various tasks such as object tracking, action recognition, video stabilization, captioning, summarization, and background subtraction. These topics will provide you with a comprehensive understanding of how deep learning models are applied to different video processing challenges and applications. From 158a12024ea681080683bcc6670a498543aa1bb5 Mon Sep 17 00:00:00 2001 From: Woojun Jung <46880056+jungnerd@users.noreply.github.com> Date: Sat, 20 Jul 2024 12:58:25 +0900 Subject: [PATCH 5/5] Apply suggestions from code review Co-authored-by: Johannes Kolbe <2843485+johko@users.noreply.github.com> --- .../en/unit7/video-processing/introduction-to-video.mdx | 9 ++++++--- 1 file changed, 6 insertions(+), 3 deletions(-) diff --git a/chapters/en/unit7/video-processing/introduction-to-video.mdx b/chapters/en/unit7/video-processing/introduction-to-video.mdx index bec44c34f..0b7cf8e57 100644 --- a/chapters/en/unit7/video-processing/introduction-to-video.mdx +++ b/chapters/en/unit7/video-processing/introduction-to-video.mdx @@ -37,10 +37,12 @@ In summary, a video is a dynamic multimedia format that combines a series of ind ## What is Video Processing? -In the research field of computer vision (CV) and artificial intelligence (AI), video processing involves automatically analyzing video data to understand and interpret both temporal and spatial features. Video data is simply a sequence of time-varying images, where the information is digitized both spatially and temporally. This allows us to perform detailed analysis and manipulation of the content within each frame of the video. +In the research field of Computer Vision (CV) and Artificial Intelligence (AI), video processing involves automatically analyzing video data to understand and interpret both temporal and spatial features. Video data is simply a sequence of time-varying images, where the information is digitized both spatially and temporally. This allows us to perform detailed analysis and manipulation of the content within each frame of the video. -Video processing has become increasingly important in today's technology-driven world, thanks to the rapid advancements in deep learning (DL) and AI. Traditionally, DL research has focused on images, speech, and text, but video data offers a unique and valuable opportunity for research due to its extensive size and complexity. With millions of videos uploaded daily on platforms like YouTube, video data has become a rich resource, driving AI research and enabling groundbreaking applications. + +Video processing has become increasingly important in today's technology-driven world, thanks to the rapid advancements in Deep Learning (DL) and AI. Traditionally, DL research has focused on images, speech, and text, but video data offers a unique and valuable opportunity for research due to its extensive size and complexity. With millions of videos uploaded daily on platforms like YouTube, video data has become a rich resource, driving AI research and enabling groundbreaking applications. + ### Applications of Video Processing @@ -66,7 +68,8 @@ Video processing, especially in surveillance and healthcare, involves handling s ## Conclusion -Video processing is a dynamic and vital area within AI and CV, offering numerous applications and presenting unique challenges. Its importance in modern technology continues to grow, fueled by advancements in deep learning and the increasing availability of video data. In the following sections, we will dive deeper into deep learning for video processing. You'll explore state-of-the-art models including 3D CNNs and transformers. +Video processing is a dynamic and vital area within AI and CV, offering numerous applications and presenting unique challenges. Its importance in modern technology continues to grow, fueled by advancements in deep learning and the increasing availability of video data. In the following sections, we will dive deeper into deep learning for video processing. You'll explore state-of-the-art models including 3D CNNs and Transformers. + Additionally, we'll cover various tasks such as object tracking, action recognition, video stabilization, captioning, summarization, and background subtraction. These topics will provide you with a comprehensive understanding of how deep learning models are applied to different video processing challenges and applications.