Getting started with vinyl: where do I begin?

Not looking for the perfect answer, just what you'd do. This came up at work last week and I couldn't let it go. Budget is limited, so I'd rather learn from your mistakes than make them myself.