He said under the leadership of Prime Minister Narendra Modi, the Parliament abrogated Article 370 to make Jammu and Kashmir an integral part of India.
Shah was speaking at the passing out parade of 70th batch of Indian Police Service (IPS) probationers at the Sardar Vallabhbhai Patel National Police Academy.
Paying rich tributes to India's first Home Minister Sardar Vallabhbhai Patel, Shah said he achieved the challenging task of merging 630 states with the Indian Union.
Recalling that the Nizam of Hyderabad State was not ready to accede to the Indian Union, Shah said Patel succeeded in making Hyderabad accede to India with the historic police action.
"Under Sri Sardar Patel's leadership, historic police action made Hyderabad, Telangana, Andhra, parts of Karnataka and Maharashtra a part of India. The credit for making this city a part of India goes to police action," he said.
Shah said Jammu and Kashmir was the last missing point as its accession to India was not complete with the continuation of Article 370. "Everyone was feeling something was missing," he said.
Stating that 33,000 policemen have so far laid down their lives for the nation, he told IPS probationers that they were going to become part of this great tradition of serving the nation.
Shah said the country faced several challenges to its internal security like terrorism, narcotics, cyber crime and challenges created by the neighbouring countries.
Stating that peace and security is a must for developed India and to achieve Modi's vision of making India a $5 trillion economy, he said without internal security and law and order, peace and security was not possible.
He recalled that Patel, as the founder of civil services, had described civil servants as protectors of national interests. He asked IPS probationers to always keep in mind the words of Patel, who had termed IPS as watchdog of corruption-free India.
Noting that most of the probationers come from middle class and poor backgrounds, Shah said God had given them an opportunity to use their position to uplift crores of poor and make India better.
Stating that becoming an IPS officer is not the goal, he told the probationers that it is just the beginning of the journey to achieve the goal. He asked them to make their contribution in taking India to a respectable place.
"Making prosperous, educated and secure India should be our goal and not personal gratification," he said.
Advising IPS officers to always play the role of safeguarding the Constitution, he said reach out to people and make close rapport with them to become ideal and successful police officers.
"I come from a cadre-based party and from my long experience I can tell you that communication, interaction and coordination are key to the success," he said.
Shah said both elected representatives and civil servants get opportunity to serve the nation but while elected representative get five years, the civil servants get this opportunity for 30 years.
He advised the IPS officers to work fearlessly within the purview of the Constitution. "There may be occasions when you get orders which don't come under the purview of the Constitution and you may be in confusion over interpretation of the Constitution. You should understand the spirit of the Constitution and implement it."
He asked IPS officers to follow the 'mantra' of SMART policing which stands for sensitive, moral, alert, responsible and techno-savvy.
A total of 103 probationers, including 12 women, passed out of the Academy. The probationers include six from Royal Bhutan Police and five from Nepal Police.
Telangana Governor E.S.L. Narasimhan, Minister of State for Home G. Kishan Reddy, Telangana Home Minister Mohammed Mehmood Ali, National Police Academy Director Abhay and others were present.
( With inputs from IANS )