jhalada, got that router issue fixed? Assuming you don't have a fixed IP address (most people don't), you should have your router configured to get its IP address and DNS addresses automatically from the ISP. It will be given a 'lease', which means that the information will be periodically updated (according to the ISP's server settings). If the ISP is well run, they won't pull an old DNS address until all clients have been updated to a new one.
Now, your PCs should be behind the NAT feature (network address translation) of your router, so that you have internal IP addresses. Generally this is done as a one-to-many NAT so that your whole network looks like a single IP address to the outside world. It is your choice whether you want to use fixed IP addresses on your PCs or DHCP (assigned IP addresses from your router), but since the DNS servers can change, you should configure the PCs to get their DNS addresses from the router (who will get them from the ISP).
The simplest thing is to configure the router as a DHCP server and leave your PCs as DHCP clients. Then, every time you boot up you will get a fresh IP address and the current DNS addresses. (If you have a particular device, such as a print server, which is more easily administered with a fixed IP address then that can be a special case. Assign a fixed IP address from a range that is excluded from the router's DHCP server range.)
Let us know how this works out for you.
/Steve