After reading this thread I checked varnishstats again:

132710400 . . bytes allocated
941031424 . . bytes free

Loads of free space!