Context

• India has joined the UN Committee of Experts on Big Data and Data Science for Official Statistics (UN-CEBD), focused on leveraging big data to monitor and report on the Sustainable Development Goals.

What is Big Data?

• Big Data refers to extremely large and complex datasets that cannot be easily managed, processed, or analyzed using traditional data processing tools.

5 Vs of Big Data

Sources

• Social Media: Facebook, Twitter, Instagram.
• Internet of Things (IoT) Devices: Sensors, Smart home devices.
• Transactions: E-commerce purchases, Bank transactions.
• Healthcare: Patient records, Medical imaging.
• Telecommunications: Call records, Data usage patterns.
• Government: Census data, Public records.

Big Data Technologies

• Storage and Processing, Databases, Data Visualization, Machine Learning, Data Analysis, Data Cleaning etc.

Challenges in Big Data

• Data Privacy and Security, Data Quality, Scalability, Skills Gap etc.

UN-CEBD

• Established: in 2014 with Australia as its first Chair.
• Development of the UN Global Platform at the end of 2017.
• Members: 31 member states and 16 international organizations

Big Data or Statistics in Indian Context

• Father of Modern Statistics in India: Prasanta Chandra Mahalanobis
• National Statistics Day: June 29th
• Constitutional Provision of term 'Statistics'
• Union List (7th Schedule): Entry 94
• Concurrent List (7th Schedule): Entry 45.

Indian Government Initiatives & Interventions

• NITI Aayog launched ‘National Data & Analytics Platform’ in May 2022.
• ‘Big Data Management Policy’ drafted by Comptroller and Auditor General (CAG)
• Establishment of a ‘National Data Warehouse on Official Statistics’
• Use of Direct Benefit Transfer in MGNREGA & Aadhaar for authentication & availing welfare scheme.
• MoU between Ministry of Agriculture and ISRO to use satellites for mapping of agricultural assets.

Related Legislations

• The Digital Personal Data Protection Bill, 2023
• The Bill will apply to the processing of digital personal data within India where such data is collected online, or collected offline and is digitised. It will also apply to such processing outside India, if it is for offering goods or services in India.

IT Act 2000

• Nature of consent: Consent is the primary means by which personal data can be processed.
• Section 43A: Compensation for failure to protect personal data.
• Section 72A: Punishment for disclosure of personal information without consent.
• Aadhaar (Targeted Delivery of Financial and Other Subsidies, Benefits, and Services) Act, 2016
• Governs the collection, storage, and use of Aadhaar data.

India's official statistical system

• Managed by the Ministry of Statistics and Programme Implementation (MoSPI)
• MoSPI Includes: Central Statistical Office (CSO) and the National Sample Survey Office (NSSO)

National Statistical Commission (NSC)

• Established: 12th July 2006
• Recommendation: Rangarajan Commission, which reviewed the Indian Statistical System in 2001.
• Aim: To evolve policies, priorities and standards in statistical matters.
• Composition: 4 Members and Chairperson