Our current economy is more crony capitalist than it is free market and that is responsible for the majority of problems that some try to blame on capitalism.
The free market, when it is allowed to do so, provides tremendous opportunity for people of all backgrounds, interests, and abilities. Crony capitalism, however, benefits the wealthy, powerful, and special interests who know how to influence policy makers. Libertarians default towards freedom in all things, including economics.
When people are allowed to run their businesses the way they see fit, without inappropriate government interference and meddling, those businesses are able to innovate and create tremendous value for consumers and more jobs for employees. Libertarians believe that the only proper role of government in the economic realm is to protect property rights, adjudicate disputes, and provide a legal framework in which voluntary trade is protected.
Unfortunately, the vast majority of regulations on the books do not do that. These regulations are heavy burdens on businesses and people who are just trying to make a living, and often prevent new businesses from starting, prevent existing businesses from hiring new employees, and even force businesses to close. This violates the rights of people to engage in peaceful and honest trade. Additionally, it actively hurts people by stifling human energy, innovation, and well-being.