ITVersity, Inc.

Introduction to commands used for processing data in files using Linux

Overview of Different File Formats

Get file format or type using file command in linux

Preview the data in the text file using head command in Linux

Preview the data in the text file using tail command

Install apache web server on Ubuntu Linux

Generate Apache Logs every second using shell script and nohup

Monitoring Logs using tail command in Linux

Preview the data in the text file using more command

Extract data from files in Linux using cut command

Sort data in files in Linux using sort command

Sort data in files in Linux using sort command based on key and delimiter

Extract Information and Redirect to a file in Linux

Getting Unique Records from File using sort in Linux

Using uniq to get unique values in Linux

Introduction to Properties of Files and Folders

Understand File and Folder Properties provided by ls command

Understanding Owner of the Files in Linux

Overview of groups associated with files and folders in Linux

Creating Groups in Linux using groupadd

Create users in Linux using useradd command

Specifying bash as default shell while creating users in Linux

Create Users with Group in Linux

Add users to supplementary or secondary groups in Linux

Overview of File Permissions in Linux

Overview of umask for default permissions on Files and Folders

Permissions on Home Folders for different Linux Users

File and Folder Permissions for Groups and Others

Conclusion for File and Folder Properties using Linux

Introduction to Managing Files and Folders in Linux

Generate empty files in linux using touch command

Creating Directories in Linux using mkdir command

Overview of awk command in Linux

Overview of cp command to copy files in Linux

Using cp command to copy files in Linux

Create multiple folders at once using awk in Linux

Copy files using Patterns in Linux

Automate file copy using awk and cp in linux

Copying folders recursively using cp command in Linux

Copying files using cp while preserving properties in Linux

Moving Files in linux using mv command

Automate file move using awk and mv in linux

Overview of tar command to take the backups

Create backup of files and folders using tar command in linux

Restoring Files and Folders using tar command in Linux

Moving Folders in Linux using mv command

Overview of rm command to remove files from Linux File System

Delete files from Linux File System using rm command

Use alias to delete files interactively from Linux File System

Delete folders from Linux File System using rm command

Restore Data Folder from the tar ball

Delete files using find and rm from Linux file system based on name

Delete files using find and awk from Linux file system based on name

Generate log files for multiple years using touch with patterns

Update timestamp of files based on names in Linux using touch

Delete files using find and rm based on modified time in Linux

Renaming the files and folders in Linux

Introduction to Basic System Commands in Linux

Overview of core components of a computer

Get CPU Details using lscpu command in Linux

Get Memory Details using free on Linux

Get Storage Details using df in Linux

Get Disk Usage Details using du in Linux

Get largest folders and files using du and sort on Linux

Get storage use of folders and files

Understand Storage Details of Directories using du on Windows

Get Storage Details of larger files using find and du

Introduction to comparing files and folders in linux using diff

Overview of diff command

Prepare Dataset to explore diff command in Linux

Understand the output of diff command in Linux

Compare Files Ignoring Blank Lines and White Spaces using diff in Linux

Compare Files Ignoring case using diff in Linux

Unified and Side By Side Comparison using diff in Linux

Compare Folders in Linux using diff command

Introduction to Variables and Environment Variables in Linux

Creating and Printing Variables using echo in Linux

Overview of Environment Variables in Linux and env command

Overview of Environment Variables in Windows

Review some of the standard environment variables in Linux

Get the location of commands in linux using which

Review PATH and unset PATH in Linux

Relevance of PATH Environment Variable while running Linux Commands

Overview of Profile and rc in Linux

Create simple shell script and grant execute permissions in Linux

Update PATH with parent folders of custom applications

Update PATH in profile with parent folders of custom applications

Introduction to Getting Started with AWS

Signing up for AWS

Overview of AWS Web Console

Overview of AWS EC2 Console or Dashboard

Create AWS EC2 Key Pair using AWS EC2 Console

Create our first AWS EC2 Instance using Ubuntu 20

Login into AWS EC2 Instance using Key Pair

Overview of AWS Free Tier and Pricing

Overview of AWS Web Console Cloud Shell

Overview of AWS EC2 Instance Concepts

Managing AWS EC2 Instances

Introduction to Overview of SSH to interact with Remote Servers

Create Multiple AWS EC2 Instances

Different Modes of SSH Login to Remote Servers

Understanding Password less login to Remote Server

Overview of SSH Daemons on Remote Servers

Understand SSH Properties Files and Properties

Enabling Password login on Remote Server

Run Commands on Remote Servers using SSH

Connect to Remote Servers from Windows using Powershell as well as wsl

Setup pssh or parallel-ssh on Mac as well as Ubuntu Linux

Run Commands on multiple servers using parallel-ssh or pssh

Run Commands on multiple servers using pssh using hosts file

Enable Password less login using ssh keys and ssh-copy-id command

Terminate AWS EC2 Instances used for demo

Introduction to Basic Networking Concepts using Linux

Provision EC2 Instance from AWS

Overview of AWS Security Groups

Overview of Different Types of IP Addresses

Install Apache Webserver on Ubuntu

Update Security Group to access Apache Web Application

Overview of Daemon or Background Processes and Ports

Understanding Structure of IP Address

Overview of DNS Aliases for IP Addresses

Install Jupyter Lab on Ubuntu

Run Jupyter Lab using Localhost

Update Security Group to access Jupyter Lab

Setup Mongo DB on AWS EC2 Instance

Run MongoDB on Universal IP Address

Update Security Group to access Mongo DB

Cleanup AWS EC2 Instance used to demo networking concepts

Introduction to Copying Files and Folders between multiple Linux Systems using scp

Provision multiple EC2 Instances from AWS

Connect to EC2 Instances using Windows Powershell

Connect to EC2 Instances from Linux on Windows

Prepare Data Sets to explore Copying Files

Overview of scp for secure copy between Multiple Systems

Copy Files using scp between Multiple Systems

Copy Folders using scp between Multiple Systems

Copy Tar Ball or Zip File using scp between Linux Servers

Setup parallel-scp or pscp to copy files to multiple systems

Prepare Target Systems by recreating folders using pssh

Copy Files on to remote machines in parallel using pscp

Copy Folders on to remote machines in parallel using pscp

Overview of Copying Files and Folders between two systems in parallel

Submit Long Running Applications or Commands in Background using nohup

Run multiple scp commands in parallel using nohup in Linux

Stop or Terminate AWS EC2 Instances used for the tasks

Introduction to Troubleshooting Applicatin Issues using find and grep in Linux

Review Standard Location for Application Logs on Linux

Setup Log Files to explore grep and find to troubleshoot the issues

Overview of Standard Log Message Format

Quick Review of find command to get log file names based on criteria

Getting help or official documentation or man page on Linux grep command

Overview of Standard Input, output and error

Redirect Linux Command or Program Results to a file

Overview of Null Device in Linux

Redirect stanard output and error to files and null device in Linux

Overview of Case Sensitivity in Linux

Search for error lines from files in Linux using find and grep

Get File Names with errors using grep and find in Linux

Perform Whole Word Search using Grep Command

Search for multiple patterns in the files using find and grep in Linux

Get number of lines with pattern using find and grep in linux

Get line number and output line using grep in Linux

Get additional lines along with error or exception lines using grep in Linux

Introduction to Monitoring and Managing Linux Servers using System Commands

Setup EC2 Instance on AWS using Ubuntu 20.04

Overview of Managing Softwares on Ubuntu using apt

Install Apache Web Server and Mongodb on Ubuntu

Manage Applications and Databases using systemctl or service command

Start Apache Web Server and Mongodb using systemctl

Overview of Service and its components

Recap of commands to get Linux Server Details

Get CPU or Load Average of Linux Server using uptime command

Overview of ps command to get details about processes on Linux Server

Get details of all the processes running on Linux Server using ps

Get list of processes owned by user on Linux Server using ps

Customize the output of ps command for specific details of processes

Number of processes on Linux Server owned by each user using ps

Get Process Details for a service on Linux Server using ps command

Overview of lsof command to get list of open files on Linux

Get open file details using lsof for a given process id

Get open file details using lsof for a given port number

Get Process Details using lsof command for a given file

Troubleshoot Port Usage on Linux using lsof command

Overview of top command in Linux to get system performance details

Getting help or man page of top command in Linux

Using Command Line Options of top command in LInux

Customize top interactive interface in Linux

Switching between groups in top interactive interface in Linux

Kill Processes using top interactive interface in Linux

Terminate AWS EC2 Instance setup to practice Linux system management commands

Introduction to Developer Tools for Linux on Windows

Install Notepad++ on Windows

Install WinScp on Windows to access files on remote Linux Servers or Sites

Add Site to WinScp for Password Login into Remote Linux Server

Add Site to WinScp for Passwordless Login into Remote Linux Server

Copying Files between Windows and Remote Linux Systems using WinScp

Opening Files on Remote Machines using WinScp and Notepad++ Locally on Windows

Overview of Advanced Editing Capabilities of Notepad++

Overview of Visual Studio Code on Windows for Remote Development

Install Visual Studio Code on Windows

Install Remote Development Extension Kit for Visual Studio Code

Setup Project on remote machine for remote development using Visual Studio Code

Open Remote Project via SSH using Visual Studio Code

Open Project via WSL using Visual Studio Code

Access Configuration Files on Remote Machines using Visual Studio Code

Install Git and Git Bash on Windows

Install Beyond Compare on Windows

Setup Repository using Git to explore Beyond Compare

Quick Demo of Beyond Compare to compare code base

Introduction to Overview of Ansible for Server Automation

Setup Ansible on Ubuntu 20.04

Provision EC2 Instances to learn Ansible

Run first command using Ansible on Multiple Instances using inline inventory

Run first command using Ansible on Multiple Instances using inventory file

Update Ansible Hosts Files on AWS EC2 Reboots

Overview of Ansible help, man page and official documentation

Add User and Group Manually in Linux

Add Group on remote instances using ansible

Adding User using Ansible user module on remote servers

Add Folder on remote systems using Ansible file module

Copy authorized keys using Ansible copy module

Setup Project Structure for Ansible Playbooks using Visual Studio Code

Create and Run first ansible playbook

Define Variables for Credentials to run Ansible Playbooks

Develop Ansible Playbook to Mange Users

Getting Started with Developing Ansible Roles

Develop and Validate Ansible Playbook with Role

Adding more tasks to the Ansible Role and Troubleshooting the issues

Create Ansible Playbook with Variables

Using Lists and Loops in Ansible Playbooks

Using Tags to run specific tasks from Playbooks

Update Ansible Role and Playbook with variables and tags

Add Variables under vars folder of Ansible Role

Terminate AWS EC2 Instances used for Ansible Tasks for Server Automation

Conclusion of Overview of Server Automation using Ansible

Introduction to Overview of Automation using Python on Linux

Validate Python and Python Modules such as pip on Ubuntu

Setup and Validate Jupyter Lab on Ubuntu

Create Folder for Notebooks using Jupyter Lab

Overview of getpass module to get username

Running Linux Shell Commands from Jupyter Notebooks

Overview of Python os module

Setup Data Sets for Python and Linux Integration

Overview of Python glob module

Overview of running Linux Commands using subprocess

Sort all files in Linux File System by size using Python

Uncompress all Compressed Files using Python on Linux

Overview of Python Multiprocessing Module

Uncompress Files in Parallel using Python multiprocessing

Add Extension to Files using Python

Overview of Copying Files using Python and scp

Run Commands on Remote Machines using Python and ssh

Copy Files to multiple systems in parallel using Python and scp