Big data, AI and ML focus of draft revised national policy on statistics

The ministry of statistics and programme implementation on Wednesday unveiled the revised draft national policy on official statistics, focused on creating an overarching framework for the creation and release of statistics in the country using big data analytics, artificial intelligence and machine learning.

“This policy will provide an overarching framework for providing reliable, timely and credible social and economic statistics to assist decision-making within and outside the Government,” the ministry stated.

The revised NPOS is introduced five years after the government released its draft policy based on suggestions from the National Statistical Commission and United Nations Fundamental Principles of Official Statistics.


“The Indian Official Statistical system is required to reorient their strategies with the emerging technologies including Artificial Intelligence (AI)/Machine Learning (ML) dovetailed with commensurate instruments of data collection, compilation processing, storage, integration, analysis and dissemination,” according to the revised policy.

Besides its focus on technology, the new policy envisages the creation of an integrated data system, optimisation of administrative statistics, innovation in surveys to reduce the burden on respondents and continuous augmentation quality of official statistics.

The ministry has been facing flak from different quarters with regard to the quality of statistics and surveys. It also held a 'chintan shivir' last month to discuss issues related to the quality and timeliness of statistics and surveys.

The revised framework talks about the creation of core statistics, the collection of which will be made mandatory for all levels of government and shall be released periodically, the revised NPOS stated.

The 79th National Sample Survey, which started last year and is due to complete this month, was a step in this direction.

National Statistical Commission (NSC) and central ministries have prepared a list of core statistics in eight domains: “National Income, Production & Services sectors, Budgetary Transactions, Money and Banking, Capital Market, Indices and other short-term indicators, External Sector, and Demography, Social and Environment Sectors.”

The draft policy states preparation of guidelines for NPOS, designation of statistical advisers and finalisation of core statistics as its short-term plan to be completed within 1-2 years. Integrated data systems, the creation of the National Data Sheet for a uniform format of data on a system, and the innovation of surveys are medium-term projects, whereas coordination with sub-national governments and training form part of the long-term plan.

The revised draft is open for public comments till September 9.