Information Technology • 6th SemesterCore / Standard CurriculumChange Track

Information Technology — 6th Semester Syllabus

CSE (Data Science)

Credits Allocation Table (L-T-P Structure)

Course TitleCodeLTPCredits
Big Data & Tools1536013003
Data Visualization1536023003
Image and Video Processing1536033003
Al and Ethics1536041001
Constitution of India1536053000
Program Elective Course-II1536XX3003
Program Elective Course-III1536XX3003
Big Data & Tools Lab153601P0042
Data Visualization Lab153602P0042
Image and Video Processing Lab153603P0021
NPTEL Course-II Lab153606P0042
TOTAL----23

Big Data and Tools

153601
Theory Course • 6 Units
View PYQ Papers

Unit-1.0: Introduction to Big Data

  • Big Data - Definition
  • Characteristic Features - Big Data Applications
  • Big Data vs Traditional Data - Risks of Big Data - Structure of Big Data - Challenges of Conventional Systems - Web Data - Evolution of Analytic Scalability - Evolution of Analytic Processes
  • Tools and methods - Analysis vs Reporting - Modern Data Analytic Tools

Unit-2.0: Hadoop

  • Introduction: History of Hadoop
  • Hadoop Ecosystem
  • Analyzing data with Hadoop
  • Hadoop Distributed File System - Design - HDFS concepts - Hadoop filesystem - Data flow - Hadoop I/O - Data integrity - Serialization - Setting up a Hadoop cluster - Cluster specification - cluster setup and installation - YARN

Unit-3.0: Map Reduce

  • Introduction: Understanding MapReduce functions - Scaling out
  • Anatomy of a MapReduce Job Run - Failures - Shuffle and sort
  • MapReduce types and formats
  • Features
  • Counters - sorting - MapReduce Applications -Configuring and setting the environment - Unit-1.0:test with MR
  • Unit-1.0:- local test

Unit-4.0: Spark

  • Installing spark - Spark applications - Jobs - Stages and Tasks - Resilient Distributed databases - Anatomy of a Spark Job Run
  • Spark on YARN
  • SCALA: Introduction
  • Classes and objects
  • Basic types and operators - built-in control structures - functions and closures - inheritance

Unit-5.0: Big Data Frameworks

  • Matrix-Vector Multiplication
  • Hadoop YARN
  • Spark
  • Aggregate Data Models
  • Hbase: Data Model and Implementations - Hbase Clients - Examples - Cassandra: Data Model - Examples - Cassandra Clients - Hadoop Integration
  • Pig
  • Grunt
  • Pig Data Model
  • Pig Latin developing and testing Pig Latin scripts
  • Hive - Data Types and File Formats - HiveQL Data Definition - HiveQL Data Manipulation - HiveQL Queries

Unit-6.0: NoSQL Databases

  • Introduction to NoSQL
  • MongoDB: Introduction Data types
  • Creating
  • Updating and deleing documents - Querying
  • Introduction to indexing
  • Capped collections
  • Hbase: Concepts
  • Hbase Vs RDBMS - Creating records
  • Accessing data Updating and deleting data
  • Modifying data - exporting and importing data
  • USE CASES: Call detail log analysis - Credit fraud alert - Weather forecast

Data Visualization

153602
Theory Course • 6 Units
View PYQ Papers

Unit-1.0: Introduction to Data and Types

  • Introduction to Data
  • The Basic Data Types - Nominal
  • Ordinal
  • Interval
  • Ratio scaled
  • Non dependency Oriented Data: Quantitative Multidimensional Data
  • Categorical and Mixed Attribute Data
  • Binary and Set Data
  • Text Data
  • Dependency-Oriented Data: Time-Series Data
  • Discrete Sequences and Strings
  • Spatial Data
  • Network and Graph Data

Unit-2.0: Fundamentals of Data Visualization

  • The visualization pipeline
  • Visualizing Data: Mapping Data onto Aesthetics
  • Coordinate Systems and Axes
  • Colour scales
  • Directory of Visualizations
  • Visualizing Amounts

Unit-3.0: Visualizing Distributions and Relationships

  • Visualizing Distributions and visualizing many Distributions at once
  • Visualizing Associations among Two or More Quantitative Variables
  • Visualizing Time series and other functions of an independent variable

Unit-4.0: Advanced Visualization Techniques

  • Visualize Trends
  • Geospatial data and uncertainty
  • Visualization of Networks and Trees
  • Visualizing multidimensional data
  • Data Reduction - Reduce Items and Attributes

Unit-5.0: Principles and Challenges in Data Visualization

  • The principles of proportional link
  • Handling overlapping points
  • Balance the data and context
  • Understanding the most commonly used Image file formats
  • Choosing the right visualization software

Unit-6.0: Data Visualization and Graphical Analysis

  • Visualized exploratory data Analysis
  • Histograms and frequency polygons
  • Box-plots
  • Quartiles
  • Scatter Plots
  • Heat Maps

Image and Video Processing

153603
Theory Course • 6 Units
View PYQ Papers

Unit-1.0: Fundamentals of Image Processing and Image Transforms

  • Digital Image fundamentals
  • Sampling and quantization of an Image
  • Relationship between pixels
  • Image Transforms: 2-D Discrete Fourier Transform
  • Properties
  • Discrete cosine Transform
  • Hadamard Transform

Unit-2.0: Image Processing Techniques

  • Image Enhancement: Spatial Domain methods: Histogram Processing
  • Fundamentals of Spatial filtering
  • Smoothing spatial filters
  • Sharpening Spatial filters
  • Frequency Domain methods: Basics of filtering in frequency domain
  • Image smoothing
  • Image sharpening
  • Color image processing: Introduction
  • Fundamentals of color image processing: Color models - RGB
  • CMY
  • YIQ
  • HSI
  • Pseudo color image processing intensity slicing
  • Gray level to color transformation
  • Basics of Full Color image processing

Unit-3.0: Image Restoration

  • Degradation Model
  • Inverse Filtering
  • Least Mean Square Filters
  • Constrained Least Squares Restoration

Unit-4.0: Image Compression

  • Image compression fundamentals coding Redundancy
  • Spatial and temporal redundancy
  • Compression models: Lossy and Lossless
  • Huffmann coding
  • Arithmetic coding
  • Run length coding
  • Transform coding
  • Predictive coding
  • JPEG standards

Unit-5.0: Basic Steps of Video Processing

  • Analog video
  • Digital video
  • Time varying image formation model
  • Geometric image formation
  • Formation
  • Sampling of video signal

Unit-6.0: 2D Motion Estimation

  • Optical flow
  • Pixel based motion estimation
  • Region based Motion estimation
  • Multi resolution motion estimation
  • Application of motion estimation in video coding

AI and Ethics

153604
Theory Course • 6 Units
View PYQ Papers

Unit-1.0:

  • Introduction: Definition of morality and ethics in AI
  • And society

Unit-2.0:

  • Impact of AI: Impact on society
  • Impact on human psychology
  • Impact on the legal system
  • Impact on the environment and the planet
  • And Impact on trust

Unit-3.0:

  • Ethical Initiatives in AI: International ethical initiatives
  • Ethical harms
  • And concerns
  • Case study: healthcare robots
  • Autonomous Vehicles
  • Warfare
  • And weaponization

Unit-4.0:

  • AI Standards And Regulation: Model Process for Addressing Ethical Concerns During System Design
  • Transparency of Autonomous Systems
  • Data Privacy Process
  • Algorithmic Bias Considerations
  • Ontological Standard for Ethically Driven Robotics and Automation Systems

Unit-5.0:

  • Rob ethics: Social and Ethical Implication of Robotics
  • Robotics- Ethics and Morality
  • Moral Theories-Ethics in Science and Technology
  • Ethical Issues in an ICT Society
  • Harmonization of Principles
  • Ethics and Professional Responsibility
  • Robotics Taxonomy

Unit-6.0:

  • Issues Challenges and Opportunities: Ethical issues in artificial intelligence
  • Societal Concerning the Application of Artificial Intelligence in Medicine
  • Decision-making role in industries
  • And National and International Strategies on AI

Constitution of India

153605
Theory Course • 6 Units
View PYQ Papers

Unit-1.0:

  • Meaning of the constitution law and constitutionalism
  • Historical perspective of the Constitution of India
  • Salient features and characteristics of the Constitution of India

Unit-2.0:

  • Scheme of the fundamental rights
  • The scheme of the Fundamental Duties and its legal status
  • The Directive Principles of State Policy - Its importance and implementation

Unit-3.0:

  • Federal structure and distribution of legislative and financial powers between the Union and the States
  • Parliamentary Form of Government in India - The constitution powers and status of the President of India

Unit-4.0:

  • Amendment of the Constitutional Powers and Procedure
  • The historical perspectives of the constitutional amendments in India

Unit-5.0:

  • Emergency Provisions: National Emergency
  • President Rule
  • Financial Emergency
  • Local Self Government - Constitutional Scheme in India

Unit-6.0:

  • Scheme of the Fundamental Right to Equality
  • Scheme of the Fundamental Right to certain Freedom under Article 19
  • Scope of the Right to Life and Personal Liberty under Article 21

Program Elective Course-II

1536XX
Theory Course • Course Details
View PYQ Papers
Available Elective Tracks & Options (5):

Program Elective: Compiler Design

153607

Unit-1.0:

Introduction: Phases of compilation and overview • Lexical Analysis (scanner): Regular languages • Finite automata • Regular expressions • From regular expressions to finite automata • Scanner generator (lex, flex)

Unit-2.0:

Syntax Analysis (Parser): Context-free languages and grammars • Push-down automata • LL(1) grammars and top-down parsing • Operator grammars • LR(O) • SLR(1) • LR(1) • LALR(1) grammars and bottom-up parsing • Ambiguity and LR parsing • LALR(1) parser generator (yacc, bison)

Unit-3.0:

Semantic Analysis: Attribute grammars • Syntax directed definition • Evaluation and flow of attribute in a syntax tree • Symbol Table: Its structure • Symbol attributes and management • Run-time environment: Procedure activation • Parameter passing • Value return • Memory allocation • And scope

Unit-4.0:

Intermediate Code Generation: Translation of different language features • Different types of intermediate forms • Code Improvement (optimization) Analysis: control-flow • Data-flow dependence etc. • Code improvement local optimization • Global optimization • Loop optimization and peep-hole optimization

Unit-5.0:

Architecture dependent code improvement: instruction scheduling (for pipeline) and loop optimization (for cache memory) • Register allocation and target code generation

Unit-6.0:

Advanced topics: Type systems • Data abstraction • Compilation of Object Oriented features and non-imperative programming languages

Program Elective: Cyber Security

153608

Unit-1.0: Cyber Security Fundamentals

Introduction • Cybercrime and Information Security • Classification of Cybercrimes • Cybercrime the legal Perspective • Cyberoffences • Cyber-attacks • Social engineering • Cyberstalking • Botnets • Attack Vector • Cybercrime and cloud computing • Cybercrimes on mobile and wireless devices • Attacks on mobile/cell phones

Unit-2.0: Authentication and Security Measures

Authentication service security • Organizational security policies and measures in mobile computing

Unit-3.0: Ethics in Cyber Security

Privacy • Intellectual Property in cyberspace • Professional Ethics • Freedom of Speech • Fair User and Ethical Hacking • Trademarks • Internet Fraud • Electronic Evidence • Forensic Technologies • Digital Evidence collection

Unit-4.0: Tools and Methods Used in Cybercrime

Introduction • Proxy Servers and Anonymizers • Phishing • Password Cracking • Keyloggers and Spywares • Virus and Worms • Phishing and Identity Theft • Trojan Horses and Backdoors • Steganography • DoS and DDoS Attacks • SQL Injection • Buffer overflows

Unit-5.0: Cybercrimes and Cyber security

Cybercrime and Legal Landscape around the world • Cyber laws • The Indian IT Act • Challenges • Digital Signatures and Indian IT Act • Amendments to the Indian IT Act • Cybercrime and punishment • Cost of Cybercrimes and IPR Issues • Web threats for Organizations • Social Computing and associated Challenges for Organizations

Unit-6.0: Cybercrime Examples and Mini-Cases

Career Paths in Cyber security • Honeypots • Case study (Official Website Hacking • E-mail spoofing • Banking related Frauds • Credit Card related Frauds)

Program Elective: Deep Learning Algorithms

153609

Unit-1.0:

Introduction to Neural Network: Brief introduction to neural networks • Error Cost Function • Mean-Square Error • Cross-Entropy • Linear vs Nonlinear functions: Activation Function Linear • Sigmoid • Softmax • Relu

Unit-2.0:

Optimization: Gradient Descent Algorithm • Momentum Based Gradient Descent Algorithm and Nesterov Accelerated Gradient Descent Algorithm

Unit-3.0:

Algorithm for Pattern Association/Reconstruction: Associative memory networks • Hetero Associative Memory neural networks • Auto Associative Memory Networks • Bi-directional Associative memory networks • Feedback Networks: Discrete Hopfield Net • Continuous Hopfield Net • Radial Basis Function Networks (RBFN): Training algorithm for an RBFN with fixed Centres

Unit-4.0:

Cluster Network: Self-Organizing Feature Map • Plasticity/Stability Problem • Adaptive Resonance Theory (ARTI and ARTII) - Architecture • ARTMAP • Dense Embeddings: word2vec - Skip-gram model • Continuous Bag Of Words (CBOW) Model

Unit-5.0:

Convolutional Neural Network: Architecture • Convolution Operation • Filters • Pooling Operation - Max pooling • Average pooling • Global pooling • Dilated CNN

Unit-6.0:

Deep Recurrent Neural Network: Long Short Term Memory (LSTM) - Architecture • Gated Recurrent Unit-1.0:(GRU) • Attention Mechanism • Recursive Neural Network • Deep Unsupervised Learning: Autoencoders • Variational Autoencoders • Adversarial Generative Networks

Program Elective: Network Security

153610

Unit-1.0:

Computer Security concepts • OSI security Architecture • Security attacks • Security Services • Security Mechanisms • Model of network security • Standards • Physical Layer Security • Network device security

Unit-2.0:

Symmetric encryption Principles • Block cipher algorithms • Random and pseudorandom numbers • Stream ciphers and RC4 • Block cipher modes • Secure hash functions • Message authentication codes • Public-key-cryptography principles • Digital signature • Access control

Unit-3.0:

Key distribution and user authentication • Kerberos • X.509 Certificates • Federated identity management • Web security considerations • Secure Socket layer • Transport layer security • HTTPS 160 • Secure Shell(SSH) • IEEE 802.11i Wireless LAN Security • Wireless application protocol overview • Wireless transport layer security • WAP end-to-end security

Unit-4.0:

Electronic mail security • Pretty good privacy • S/MIME • Domain keys Identified Mail • IP Security overview • IP security Policy • Encapsulating security payload • Combining security association • Internet key exchange • DNSSec • eSMTPS • TCP session hijacking • ARP attacks • Route table modification • UDP hijacking • And man-in-the-middle attacks

Unit-5.0:

System Security- Types of malicious software • Viruses • Worms • DoS • DDoS • BOF • Countermeasures • IDS concepts • IDS types and detection models • IDS features • IDS deployment considerations • Firewalls characteristics • Types of Firewalls • Firewall location and Configuration

Unit-6.0:

Voice over IP (VoIP) and PBX security • VoIP components • VoIP vulnerabilities and countermeasures • Securing a PBX • Proxy or application level gateways as security devices • VPN • Privacy protection and anonymity services • Electronic payment system

Program Elective: Soft Computing

153611

Unit-1.0:

Introduction to Soft Computing: Evolution of Computing: Soft Computing Constituents • Soft vs Hard Computing • From Conventional AI to Computational Intelligence: Machine Learning Basics

Unit-2.0:

Neural Networks: Machine Learning Using Neural Network • Adaptive Networks • Feed forward Networks • Supervised Learning Neural Networks

Unit-3.0:

Radial Basis Function Networks: Reinforcement Learning • Unsupervised Learning Neural Networks • Adaptive Resonance architectures • Advances in Neural networks

Unit-4.0:

Fuzzy Systems: Fuzzy Sets • Operations on Fuzzy Sets • Fuzzy Relations • Membership Functions: Fuzzy Rules and Fuzzy Reasoning • Fuzzy Inference Systems • Fuzzy Expert Systems • Fuzzy Decision Making • Fuzzy based Back Propagation network

Unit-5.0:

Genetic Algorithm: Introduction to Genetic Algorithms (GA) • Applications of GA in Machine Learning: Machine Learning Approach to Knowledge Acquisition • GA based Back P

Unit-6.0:

Matlab/Python Lib: Introduction to Matlab/Python • Arrays and array operations • Functions and Files • Study of neural network toolbox and fuzzy logic toolbox • Simple implementation of Artificial Neural Network and Fuzzy Logic

Program Elective Course-III

1536XX
Theory Course • Course Details
View PYQ Papers
Available Elective Tracks & Options (6):

Program Elective: Adversarial Machine Learning

153612

Unit-1.0:

Overview of adversarial machine learning • Statistical machine learning • A framework for secure learning • Security analysis • Framework • Exploratory attacks • Causative attacks • Repeated learning games • Privacy-Preserving learning

Unit-2.0:

Attacking a hypersphere learner • Causative attacks on hypersphere detectors • Hypersphere attack description • Optimal unconstrained attacks • Imposing time constraints on the attack • Attacks against retraining with data replacements • Constrained attackers

Unit-3.0:

Availability attack Case Study: SpamBayes • Spam Filter • Threat model • Causative attacks • RONI Defense • Experiments with SpamBayes

Unit-4.0:

Integrity Attack Case Study: PCA Detector • Traffic anomalies • Corrupting the PCA subspace • Corruption-Resilient Detectors • Empirical evaluation

Unit-5.0:

Privacy-Preserving Mechanism for SVM learning • Privacy Breach case studies • Problem setting: privacy-preserving learning • Support Vector Machines: A brief primer • Differential privacy

Unit-6.0:

Near optimal evasion of classifiers • Convex classes • Adversarial machine learning challenges • Open problems • Defensive technologies

Program Elective: Distributed System Design

153613

Unit-1.0:

Introduction: Motivation for distributed systems • Characteristics of distributed systems and middleware categories • Network service requirements for distributed systems • Architectural models of distributed systems • Interprocess communication: Multithreading models and multithreaded client/server architectures • Hardware virtualization • Code mobility • Virtual machine migration • Interprocess communication paradigms in distributed systems

Unit-2.0:

Naming: Naming scheme and namespace • URI • URN • URL • Name resolution and DNS naming service • Naming and location services of mobile entities • Distributed garbage collection • Synchronization: Clock synchronization • NTP and GPS • Lamport's clock and vector clock • Total-ordered and causal-ordered multicasting • Election and mutual exclusion in distributed systems • Coordination: Coordination models • Direct and indirect coordination • Gossip based and group coordination • Publish-subscribe coordination

Unit-3.0:

Consistency: Consistency models • Data-centric and client-centric consistency • Linearizability • Sequential • Causal and FIFO consistency • Eventual consistency • Monotonic read/write • Read-your-writes • Writes-follow-reads consistency • Replication: Replication system architecture and functioning • Passive and active replication • Replication in gossip architecture • Consistency models and protocols in replication • Continuous consistency and conit • Replica management • Placement and distribution

Unit-4.0:

Fault Tolerance: Dependability • Failure model • Failure handling and resiliency • Reliable group communication • Distributed commit and consensus • Failure Recovery: Forward-error and backward-error recovery • Rollback and checkpointing • Message logging

Unit-5.0:

Distributed object-based and component-based systems: Distributed objects • Object servers and adapters • Distributed components and containers • Distributed event-based systems: Distributed event-based system architectures • Communication • Matching and filtering • Content-based

Unit-6.0:

Distributed web-based systems: Web service descriptions • SOAP and REST protocol • UDDI service • Web servers and web server clusters • Distributed file systems: Distributed file system design requirements • File service architecture • Pervasive systems: Sensor • Actuator and IoT • Ubiquity • Sensor network • Context awareness

Program Elective: Introduction to Wireless Networks

153614

Unit-1.0: Introduction

Overview of wireless and mobile infrastructure • Preliminary concepts on cellular architecture • Design objectives and performance issues • Radio resource management and interface • Propagation and path loss models • Channel interference and frequency reuse • Cell splitting • Channel assignment strategies • Overview of generations: - 1G to 5G

Unit-2.0: Location Management

Introduction to location management (HLR and VLR) • Mobility models characterizing individual node movement (Random walk • Fluid flow • Markovian • Activity based) • Mobility models characterizing the movement of groups of nodes (Reference point based group mobility model • Community based group mobility model) • Static (Always vs. Never update • Reporting Cells • Location Areas) and Dynamic location management schemes (Time • Movement • Distance • Profile Based) • Terminal Paging (Simultaneous paging • Sequential paging) • Location management and Mobile IP

Unit-3.0: Handoff Management

Overview of handoff process • Factors affecting handoffs and performance evaluation metrics • Handoff strategies • Different types of handoffs (soft • Hard • Horizontal • Vertical)

Unit-4.0: Basics of Wireless Transmission

Introduction to narrow and wideband systems • Spread spectrum • Frequency hopping • Introduction to MIMO • MIMO Channel Capacity and diversity gain • Introduction to OFDM • MIMO-OFDM system • Multiple access control (FDMA • TDMA • CDMA • SDMA) • Wireless local area network • Wireless personal area network (Bluetooth and Zigbee)

Unit-5.0: Cognitive Radio Networks

Fixed and dynamic spectrum access • Direct and indirect spectrum sensing • Spectrum sharing • Interoperability and co-existence issues • Applications of cognitive radio networks

Unit-6.0: Basics Of 5g Networks

Introduction to D2D communications • High level requirements for 5G architecture • Introduction to the radio resource management • Power control and mode selection problems • Milli-meterwave communication in 5G

Program Elective: Intrusion Detection

153615

Unit-1.0:

Network Attacks • Understanding Intrusion Detection and Intrusion Prevention System • Detection Approaches (Misuse Detection • Anomaly Detection • Etc.) • Uses of IDPS Technologies • Key Functions of IDPS Technologies • Stateful Protocol Analysis

Unit-2.0:

Data Collection (Host-Based • Network-Based • Application-Based • Application-Integrated and Hybrid) • Theoretical Foundations of Detection Taxonomy of anomaly detection system • Fuzzy logic • Bayes theorem • Artificial Neural networks • Support vector machine • Evolutionary computation • Association rules • Clustering • Architecture and Implementation

Unit-3.0:

IDS Challenges • Alert Management & Correlation (Data Fusion • Alert Correlation • Cooperative Intrusion Detection) • Evaluation Criteria- Accuracy • Performance • Completeness • Timely Response • Adaptation and Cost-Sensitivity • Intrusion Tolerance and Attack Resistance • Test • Intrusion Response

Unit-4.0:

Security and IDS Management (Data Correlation • Incident Response • Policy and Procedures • Law • Standards and organizations • Security Business issues • Future of Intrusion Detection and Prevention)

Unit-5.0:

Implementation and Deployment: Internet Security System's Real Source • Snort • NFR Security • IDS Tools • Detailed case study of IDS in different networks like Ethernet Networks • 802.11 Networks • Mobile Networks • Ad-hoc Networks • And Wireless Sensor Networks

Unit-6.0:

Introduction to Snort • Different modes of Snort • Snort IDS Components • Snort Rules • Snort Filters • Snort output • Alert modes

Program Elective: Natural Language Processing

153616

Unit-1.0:

Sound: Biology of Speech Processing • Place and Manner of Articulation • Word Boundary Detection • Argmax based computations • HMM and Speech Recognition

Unit-2.0:

Words and Word Forms: Morphology fundamentals • Morphological Diversity of Indian Languages • Morphology Paradigms • Finite State Machine Based Morphology • Automatic Morphology Learning • Shallow Parsing • Named Entities • Maximum Entropy Models • Random Fields

Unit-3.0:

Structures: Theories of Parsing • Parsing Algorithms • Robust and Scalable Parsing on Noisy Text as in Web documents

Unit-4.0:

Hybrid of Rule Based and Probabilistic Parsing • Scope Ambiguity and Attachment Ambiguity resolution

Unit-5.0:

Meaning: Lexical Knowledge Networks • Wordnet Theory • Indian Language Wordnets and Multilingual Dictionaries • Semantic Roles • Word Sense Disambiguation • WSD and Multilinguality • Metaphors • Coreferences

Unit-6.0:

Web 2.0 Applications: Sentiment Analysis • Text Entailment • Robust and Scalable Machine Translation • Question Answering in Multilingual Setting • Cross Lingual Information Retrieval (CLIR)

Program Elective: Reinforcement Learning

153617

Unit-1.0: Introduction to Reinforcement Learning Problem

Reinforcement Learning • Elements of Reinforcement Learning • Limitations and Scope • An Extended Example: Tic-Tac-Toe • History of Reinforcement Learning

Unit-2.0: Multi-arm Bandits

An n-Armed Bandit Problem • Action-Value Methods • Incremental Implementation • Tracking a Nonstationary Problem • Optimistic Initial Values • Upper-Confidence-Bound

Unit-3.0: Finite Markov Decision Processes

The Agent-Environment Interface • Goals and Rewards • Returns • Unified Notation for Episodic and Continuing Tasks • The Markov Property • Markov Decision Processes • Value Functions • Optimal Value Functions • Optimality and Approximation

Unit-4.0: Dynamic Programming

Policy Evaluation • Policy Improvement • Policy Iteration • Value Iteration • Asynchronous Dynamic Programming • Generalized Policy Iteration • Efficiency of Dynamic Programming

Unit-5.0: BMonte Carlo Methods

Monte Carlo Prediction • Monte Carlo Estimation of Action Values • Monte Carlo Control • Monte Carlo Control without Exploring Starts • Off-policy Prediction via Importance Sampling • Incremental Implementation • Off-Policy Monte Carlo Control • Importance Sampling on Truncated Returns

Unit-6.0: Temporal-Difference Learning and Policy Approximation

TD Prediction • Advantages of TD Prediction Methods • Optimality of TD(0) • Sarsa: On-Policy TD Control • Q-Learning: Off-Policy TD Control • Games • Actor-Critic Methods • Eligibility Traces for Actor-Critic Methods • R-Learning and the Average-Reward Setting • Vanilla policy gradient method

Big Data and Tools Lab

153601P
Laboratory Subject • 1 Units
View PYQ Papers

Topics Part 1

  • Exploring Big Data Characteristics (Python/Pandas): Load a large dataset and analyze its characteristics based on the 5Vs (Volume, Velocity, Variety, Veracity, and Value)
  • Comparing SQL and Big Data Processing (SQLite/PySpark): Perform the same queries on a dataset using both SQLite and PySpark, and compare execution times
  • Modern Data Analytic Tools (Hadoop/Spark/Kafka): Install and explore Hadoop, Spark, and Kafka. Write a basic PySpark program to process a text file
  • HDFS File Operations (Hadoop/MinIO): Perform basic file operations (upload, download, list, delete) in HDFS or MinIO
  • Map Reduce Word Count Program (Java/Python MapReduce): Implement a MapReduce program to count word occurrences in a text file
  • Matrix-Vector Multiplication Using MapReduce (Hadoop/PySpark): Implement matrix-vector multiplication using MapReduce and execute it on Hadoop or PySpark
  • Hadoop YARN & Spark Execution (YARN/PySpark): Submit a PySpark job on Hadoop YARN and monitor its execution
  • Predictive Analytics using Spark MLlib (PySpark MLlib): Train and test a logistic regression model using Spark MLlib
  • NoSQL Database Operations with Cassandra (Cassandra/MongoDB): Create a NoSQL database, insert data, and perform queries using Cassandra or MongoDB
  • Big Data Querying using Hive & Pig (HiveQL/Pig Latin): Execute data manipulation and querying tasks using HiveQL and Pig Latin

Prescribed Experiments

  1. Exploring Big Data Characteristics (Python/Pandas): Load a large dataset and analyze its characteristics based on the 5Vs (Volume, Velocity, Variety, Veracity, and Value)
  2. Comparing SQL and Big Data Processing (SQLite/PySpark): Perform the same queries on a dataset using both SQLite and PySpark, and compare execution times
  3. Modern Data Analytic Tools (Hadoop/Spark/Kafka): Install and explore Hadoop, Spark, and Kafka. Write a basic PySpark program to process a text file
  4. HDFS File Operations (Hadoop/MinIO): Perform basic file operations (upload, download, list, delete) in HDFS or MinIO
  5. Map Reduce Word Count Program (Java/Python MapReduce): Implement a MapReduce program to count word occurrences in a text file
  6. Matrix-Vector Multiplication Using MapReduce (Hadoop/PySpark): Implement matrix-vector multiplication using MapReduce and execute it on Hadoop or PySpark
  7. Hadoop YARN & Spark Execution (YARN/PySpark): Submit a PySpark job on Hadoop YARN and monitor its execution
  8. Predictive Analytics using Spark MLlib (PySpark MLlib): Train and test a logistic regression model using Spark MLlib
  9. NoSQL Database Operations with Cassandra (Cassandra/MongoDB): Create a NoSQL database, insert data, and perform queries using Cassandra or MongoDB
  10. Big Data Querying using Hive & Pig (HiveQL/Pig Latin): Execute data manipulation and querying tasks using HiveQL and Pig Latin

Data Visualization Lab

153602P
Laboratory Subject • 1 Units
View PYQ Papers

Topics Part 1

  • Exploring Different Data Types (Python/Pandas): Load a dataset and classify its attributes into nominal, ordinal, interval, and ratio scales
  • Handling Non-Dependency Oriented Data (Python/Numpy): Process and visualize different types of non-dependency data (e.g., categorical, binary, text) using NumPy and Pandas
  • Analyzing Dependency-Oriented Data (Python/Matplotlib): Load and visualize time-series, spatial, or network data using appropriate plotting techniques
  • Understanding the Visualization Pipeline (Python/Seaborn): Demonstrate the process of transforming raw data into visual insights using a structured visualization pipeline
  • Mapping Data onto Aesthetics (Python/Matplotlib/Seaborn): Apply aesthetics such as color, shape, and size to visualize data attributes effectively
  • Using Different Coordinate Systems (Python/Matplotlib): Compare Cartesian, polar, and logarithmic coordinate systems with different types of plots
  • Applying Color Scales in Visualizations (Python/Seaborn): Create visualizations using various color palettes and explain their impact on interpretation
  • Visualizing Data Distributions (Python/Seaborn): Create histograms, density plots, and box plots to analyze data distributions
  • Comparing Multiple Distributions (Python/Seaborn/Matplotlib): Use violin plots and swarm plots to visualize multiple distributions simultaneously
  • Visualizing Relationships Between Variables (Python/Seaborn): Create scatter plots, pair plots, and correlation matrices to analyze associations between variables
  • Visualizing Time-Series Data (Python/Matplotlib/Pandas): Plot time-series data with trendlines and moving averages to observe patterns over time
  • Visualizing Geospatial Data (Python/Folium/GeoPandas): Plot geospatial data on maps using Python libraries like Folium or GeoPandas
  • Network and Tree Visualization (Python/NetworkX/Matplotlib): Generate and visualize a network graph or hierarchical tree structure
  • Handling Multidimensional Data (Python/Seaborn/PCA): Reduce dimensionality using PCA and visualize high-dimensional data using pair plots or 3D scatter plots
  • Handling Overlapping Data Points (Python/Seaborn/Matplotlib): Implement jittering, transparency, or faceting to reduce clutter in visualizations
  • Comparing Image File Formats for Visualization (Python/OpenCV): Save a visualization in different formats (JPEG, PNG, SVG) and compare quality vs. size
  • Choosing the Right Visualization Tool (Python/Tableau/Power BI): Compare different visualization tools like Matplotlib, Tableau, and Power BI for specific use cases

Prescribed Experiments

  1. Exploring Different Data Types (Python/Pandas): Load a dataset and classify its attributes into nominal, ordinal, interval, and ratio scales
  2. Handling Non-Dependency Oriented Data (Python/Numpy): Process and visualize different types of non-dependency data (e.g., categorical, binary, text) using NumPy and Pandas
  3. Analyzing Dependency-Oriented Data (Python/Matplotlib): Load and visualize time-series, spatial, or network data using appropriate plotting techniques
  4. Understanding the Visualization Pipeline (Python/Seaborn): Demonstrate the process of transforming raw data into visual insights using a structured visualization pipeline
  5. Mapping Data onto Aesthetics (Python/Matplotlib/Seaborn): Apply aesthetics such as color, shape, and size to visualize data attributes effectively
  6. Using Different Coordinate Systems (Python/Matplotlib): Compare Cartesian, polar, and logarithmic coordinate systems with different types of plots
  7. Applying Color Scales in Visualizations (Python/Seaborn): Create visualizations using various color palettes and explain their impact on interpretation
  8. Visualizing Data Distributions (Python/Seaborn): Create histograms, density plots, and box plots to analyze data distributions
  9. Comparing Multiple Distributions (Python/Seaborn/Matplotlib): Use violin plots and swarm plots to visualize multiple distributions simultaneously
  10. Visualizing Relationships Between Variables (Python/Seaborn): Create scatter plots, pair plots, and correlation matrices to analyze associations between variables
  11. Visualizing Time-Series Data (Python/Matplotlib/Pandas): Plot time-series data with trendlines and moving averages to observe patterns over time
  12. Visualizing Geospatial Data (Python/Folium/GeoPandas): Plot geospatial data on maps using Python libraries like Folium or GeoPandas
  13. Network and Tree Visualization (Python/NetworkX/Matplotlib): Generate and visualize a network graph or hierarchical tree structure
  14. Handling Multidimensional Data (Python/Seaborn/PCA): Reduce dimensionality using PCA and visualize high-dimensional data using pair plots or 3D scatter plots
  15. Handling Overlapping Data Points (Python/Seaborn/Matplotlib): Implement jittering, transparency, or faceting to reduce clutter in visualizations
  16. Comparing Image File Formats for Visualization (Python/OpenCV): Save a visualization in different formats (JPEG, PNG, SVG) and compare quality vs. size
  17. Choosing the Right Visualization Tool (Python/Tableau/Power BI): Compare different visualization tools like Matplotlib, Tableau, and Power BI for specific use cases

Image and Video Processing Lab

153603P
Laboratory Subject • 1 Units
View PYQ Papers

Topics Part 1

  • Image Sampling and Quantization (Python/OpenCV/MATLAB/Octave): Reduce image resolution (sampling) and change bit depth (quantization) to observe effects on image quality
  • Pixel Relationships and Neighborhood Operations (Python/OpenCV/MATLAB/Octave): Implement 4-connected and 8-connected neighborhood pixel analysis, and compute pixel intensity differences
  • Histogram Equalization (Python/OpenCV/MATLAB/Octave): Compute and visualize image histograms and apply histogram equalization for contrast enhancement
  • Spatial Filtering - Smoothing (Python/OpenCV/MATLAB/Octave): Apply mean, Gaussian, and median filters to remove noise and compare results
  • Spatial Filtering - Sharpening (Python/OpenCV/MATLAB/Octave): Implement Laplacian and high-pass filters to enhance edges in an image
  • Frequency Domain Filtering (Python/OpenCV/MATLAB/Octave): Perform Fourier Transform, apply low-pass and high-pass filtering, and reconstruct the image in the spatial domain
  • Color Model Conversion (Python/OpenCV/MATLAB/Octave): Convert an image between RGB, CMY, YIQ, and HSI color spaces and analyze the differences
  • Pseudo Color Processing (Python/OpenCV/MATLAB/Octave): Implement intensity slicing and grayscale-to-color transformation techniques
  • Image Degradation and Restoration (Python/OpenCV/MATLAB/Octave): Simulate image degradation (motion blur, Gaussian noise) and restore it using inverse filtering
  • Least Mean Square (Wiener) Filtering (Python/OpenCV/MATLAB/Octave): Apply Wiener filtering to restore a noisy and blurred image
  • Lossless Compression - Huffman Encoding (Python/MATLAB/Octave): Implement Huffman encoding and decoding for image compression
  • Lossy Compression JPEG Analysis (Python/OpenCV/MATLAB/Octave): Apply JPEG compression and analyze its effect on image quality by varying quality factors
  • Video Frame Extraction (Python/OpenCV/MATLAB/Octave): Extract frames from a video file and display them sequentially
  • Motion Detection in Video (Python/OpenCV/MATLAB/Octave): Implement background subtraction techniques to detect moving objects in a video
  • Optical Flow Estimation (Python/OpenCV/MATLAB/Octave): Implement optical flow algorithms (e.g., Lucas-Kanade) to estimate motion in a video sequence

Prescribed Experiments

  1. Image Sampling and Quantization (Python/OpenCV/MATLAB/Octave): Reduce image resolution (sampling) and change bit depth (quantization) to observe effects on image quality
  2. Pixel Relationships and Neighborhood Operations (Python/OpenCV/MATLAB/Octave): Implement 4-connected and 8-connected neighborhood pixel analysis, and compute pixel intensity differences
  3. Histogram Equalization (Python/OpenCV/MATLAB/Octave): Compute and visualize image histograms and apply histogram equalization for contrast enhancement
  4. Spatial Filtering - Smoothing (Python/OpenCV/MATLAB/Octave): Apply mean, Gaussian, and median filters to remove noise and compare results
  5. Spatial Filtering - Sharpening (Python/OpenCV/MATLAB/Octave): Implement Laplacian and high-pass filters to enhance edges in an image
  6. Frequency Domain Filtering (Python/OpenCV/MATLAB/Octave): Perform Fourier Transform, apply low-pass and high-pass filtering, and reconstruct the image in the spatial domain
  7. Color Model Conversion (Python/OpenCV/MATLAB/Octave): Convert an image between RGB, CMY, YIQ, and HSI color spaces and analyze the differences
  8. Pseudo Color Processing (Python/OpenCV/MATLAB/Octave): Implement intensity slicing and grayscale-to-color transformation techniques
  9. Image Degradation and Restoration (Python/OpenCV/MATLAB/Octave): Simulate image degradation (motion blur, Gaussian noise) and restore it using inverse filtering
  10. Least Mean Square (Wiener) Filtering (Python/OpenCV/MATLAB/Octave): Apply Wiener filtering to restore a noisy and blurred image
  11. Lossless Compression - Huffman Encoding (Python/MATLAB/Octave): Implement Huffman encoding and decoding for image compression
  12. Lossy Compression JPEG Analysis (Python/OpenCV/MATLAB/Octave): Apply JPEG compression and analyze its effect on image quality by varying quality factors
  13. Video Frame Extraction (Python/OpenCV/MATLAB/Octave): Extract frames from a video file and display them sequentially
  14. Motion Detection in Video (Python/OpenCV/MATLAB/Octave): Implement background subtraction techniques to detect moving objects in a video
  15. Optical Flow Estimation (Python/OpenCV/MATLAB/Octave): Implement optical flow algorithms (e.g., Lucas-Kanade) to estimate motion in a video sequence

NPTEL Course-II Lab

153606P
Laboratory Subject • Course Details
View PYQ Papers