If there are no Global Elite, Why not end the "Fed"?

The Federal Reserve Act of 1913 granted a group of powerful bankers the power to print our money. This power was granted to the government itself in the Constitution. If there is no power above our Tricameral (judicial, legislative and executive) system of government, don't you think that the government itself would have had this power returned to the people by this point in time?