We present a modified version of the entrepreneurial choice model, where it is shown that the expected utility of becoming an entrepreneur is decreasing in both the levels of taxes and the tax administrative burden. We extend previous empirical findings by examining how these variables influence entrepreneurs at different stages in the entrepreneurial life cycle. Our findings imply that the effect of the tax administrative burden varies over the entrepreneurial life cycle from strongly negative to insignificant. The most pronounced negative effects appear in the early stages of entrepreneurship. We conclude that a 10% reduction in the tax administrative burden increases the propensity for new business establishments by 4%. Our findings support the idea that tax simplification is one way to encourage entrepreneurship, without any reduction in tax revenues.