Build failed "likely due to infinite recursion" - 0.10.0 + 0.125.4 + 0.5 million files... #1988

marshalc · 2024-05-03T09:05:25Z

marshalc
May 3, 2024

A plea for help as I'm getting exasperated by my current project site (a script built auto-documentation system that pulls configuration data from the platform's core DB, and writes it out as Markdown along with some bits of analysis and linking and grouping of related data, etc).

I last had something close to this amount of files building successfully a year ago using a lightly modified Docsy theme (https://github.com/ouhft/docsy/tree/ouhft) along with Hugo 0.120.x, but significantly (and I've posted about this on the Hugo forum before) the memory requirements for such a build meant most machines couldn't handle it (the only two that could have 128GB of RAM and were adding an additional 200GB of Swap as well). Thus I've been really looking forward to testing the memory improvements of Hugo 0.124 onwards... only that caused other complications that broke Docsy, and we're now at a stage with the 0.10.0 release (well done Chalin et al!) that I hoped I'd get a working build.

But no.

Having finally removed all the bad link references that I'd managed to auto-mis-generate, I'm still having a failing build that mostly complains about:

Error: error building site: render: failed to render pages: render of "section" failed: "/Users/carl/.local/share/hugo/modules/filecache/modules/pkg/mod/github.com/ouhft/docsy@v0.0.0-20240502234050-7418d2d85b16/layouts/docs/baseof.html:4:7": execute of template failed: template: docs/list.html:4:7: executing "docs/list.html" at <partial "head.html" .>: error calling partial: partial "head.html" timed out after 6m0s. This is most likely due to infinite recursion. If this is just a slow template, you can try to increase the 'timeout' config setting.

I've tried to increase the timeout, from the default of 30s, to 180s, and then 360s... this hasn't changed the outcome, only increased the overall time to failure.

To give you some more detail - this is the output from the 360s timeout run:

hugo --cleanDestinationDir --gc --templateMetrics --logLevel debug
Start building sites …
hugo v0.125.4+extended darwin/amd64 BuildDate=2024-04-25T13:27:26Z VendorInfo=brew

INFO  static: removing all files from destination that don't exist in static dirs
INFO  static: syncing static files to / duration 8m25.01931386s
INFO  build:  step process substep collect files 1000 files_total 1000 duration 7.512630902s
INFO  build:  step process substep collect files 8000 files_total 9000 duration 3.031930096s
INFO  build:  step process substep collect files 7000 files_total 16000 duration 3.043881174s
INFO  build:  step process substep collect files 8000 files_total 24000 duration 3.188753349s
INFO  build:  step process substep collect files 9000 files_total 33000 duration 3.340914284s
INFO  build:  step process substep collect files 10000 files_total 43000 duration 3.067269883s
INFO  build:  step process substep collect files 9000 files_total 52000 duration 3.200981535s
INFO  build:  step process substep collect files 9000 files_total 61000 duration 3.152729914s
INFO  build:  step process substep collect files 9000 files_total 70000 duration 3.113769484s
INFO  build:  step process substep collect files 8000 files_total 78000 duration 3.056697039s
INFO  build:  step process substep collect files 9000 files_total 87000 duration 3.189905118s
INFO  build:  step process substep collect files 8000 files_total 95000 duration 3.101378018s
INFO  build:  step process substep collect files 9000 files_total 104000 duration 3.017199444s
INFO  build:  step process substep collect files 8000 files_total 112000 duration 3.168947495s
INFO  build:  step process substep collect files 9000 files_total 121000 duration 3.110140007s
INFO  build:  step process substep collect files 9000 files_total 130000 duration 3.163804678s
INFO  build:  step process substep collect files 9000 files_total 139000 duration 3.344476081s
INFO  build:  step process substep collect files 5000 files_total 144000 duration 3.101938256s
INFO  build:  step process substep collect files 8000 files_total 152000 duration 3.176173957s
INFO  build:  step process substep collect files 8000 files_total 160000 duration 3.04928593s
INFO  build:  step process substep collect files 10000 files_total 170000 duration 3.252538435s
INFO  build:  step process substep collect files 8000 files_total 178000 duration 3.303951173s
INFO  build:  step process substep collect files 8000 files_total 186000 duration 3.138463991s
INFO  build:  step process substep collect files 10000 files_total 196000 duration 3.338092864s
INFO  build:  step process substep collect files 8000 files_total 204000 duration 3.388345731s
INFO  build:  step process substep collect files 11000 files_total 215000 duration 3.159291907s
INFO  build:  step process substep collect files 9000 files_total 224000 duration 3.211725985s
INFO  build:  step process substep collect files 8000 files_total 232000 duration 3.371114667s
INFO  build:  step process substep collect files 9000 files_total 241000 duration 3.237003794s
INFO  build:  step process substep collect files 8000 files_total 249000 duration 3.076936029s
INFO  build:  step process substep collect files 9000 files_total 258000 duration 3.302739489s
INFO  build:  step process substep collect files 8000 files_total 266000 duration 3.302219855s
INFO  build:  step process substep collect files 9000 files_total 275000 duration 3.122306438s
INFO  build:  step process substep collect files 9000 files_total 284000 duration 3.404332826s
INFO  build:  step process substep collect files 8000 files_total 292000 duration 3.03985953s
INFO  build:  step process substep collect files 9000 files_total 301000 duration 3.179866516s
INFO  build:  step process substep collect files 9000 files_total 310000 duration 3.231518814s
INFO  build:  step process substep collect files 8000 files_total 318000 duration 3.136342127s
INFO  build:  step process substep collect files 9000 files_total 327000 duration 3.224943797s
INFO  build:  step process substep collect files 9000 files_total 336000 duration 3.296673193s
INFO  build:  step process substep collect files 6000 files_total 342000 duration 3.168410064s
INFO  build:  step process substep collect files 9000 files_total 351000 duration 3.345290785s
INFO  build:  step process substep collect files 8000 files_total 359000 duration 3.075100173s
INFO  build:  step process substep collect files 9000 files_total 368000 duration 3.142451483s
INFO  build:  step process substep collect files 8000 files_total 376000 duration 3.76449113s
INFO  build:  step process substep collect files 5000 files_total 381000 duration 3.627642037s
INFO  build:  step process substep collect files 5000 files_total 386000 duration 3.615150999s
INFO  build:  step process substep collect files 6000 files_total 392000 duration 3.221410776s
INFO  build:  step process substep collect files 9000 files_total 401000 duration 3.226754831s
INFO  build:  step process substep collect files 9000 files_total 410000 duration 3.214309653s
INFO  build:  step process substep collect files 8000 files_total 418000 duration 3.039719621s
INFO  build:  step process substep collect files 8000 files_total 426000 duration 3.087553337s
INFO  build:  step process substep collect files 7000 files_total 433000 duration 3.067665903s
INFO  build:  step process substep collect files 9000 files_total 442000 duration 3.251667745s
INFO  build:  step process substep collect files 9000 files_total 451000 duration 3.234450695s
INFO  build:  step process substep collect files 6000 files_total 457000 duration 3.262367654s
INFO  build:  step process substep collect files 4000 files_total 461000 duration 3.078330431s
INFO  build:  step process substep collect files 5000 files_total 466000 duration 4.008193683s
INFO  build:  step process substep collect files 4000 files_total 470000 duration 3.357312493s
INFO  build:  step process substep collect files 4000 files_total 474000 duration 3.752992335s
INFO  build:  step process substep collect files 1855 files_total 475855 duration 2.240367166s
INFO  build:  step process duration 3m20.63617732s
INFO  build:  step assemble duration 7m26.138609834s
INFO  postcss: use config file "/Users/carl/.local/share/hugo/modules/filecache/modules/pkg/mod/github.com/ouhft/docsy@v0.0.0-20240502234050-7418d2d85b16/postcss.config.js"
INFO  dynacache: adjusted partitions' max size evicted 25801 numGC 139 limit 32.00 GB alloc 32.12 GB totalAlloc 418.62 GB
INFO  dynacache: adjusted partitions' max size evicted 3091 numGC 140 limit 32.00 GB alloc 33.27 GB totalAlloc 434.90 GB
INFO  dynacache: adjusted partitions' max size evicted 8935 numGC 145 limit 32.00 GB alloc 32.09 GB totalAlloc 506.09 GB
INFO  dynacache: adjusted partitions' max size evicted 25156 numGC 149 limit 32.00 GB alloc 33.41 GB totalAlloc 567.95 GB
INFO  dynacache: adjusted partitions' max size evicted 25810 numGC 150 limit 32.00 GB alloc 36.30 GB totalAlloc 570.85 GB
INFO  dynacache: adjusted partitions' max size evicted 23073 numGC 168 limit 32.00 GB alloc 32.17 GB totalAlloc 880.52 GB
INFO  dynacache: adjusted partitions' max size evicted 25165 numGC 168 limit 32.00 GB alloc 33.77 GB totalAlloc 882.12 GB
INFO  dynacache: adjusted partitions' max size evicted 18457 numGC 169 limit 32.00 GB alloc 32.13 GB totalAlloc 894.49 GB
INFO  dynacache: adjusted partitions' max size evicted 25165 numGC 169 limit 32.00 GB alloc 33.90 GB totalAlloc 896.26 GB
INFO  dynacache: adjusted partitions' max size evicted 19791 numGC 171 limit 32.00 GB alloc 33.39 GB totalAlloc 925.66 GB
INFO  dynacache: adjusted partitions' max size evicted 25165 numGC 171 limit 32.00 GB alloc 34.44 GB totalAlloc 926.71 GB
INFO  dynacache: adjusted partitions' max size evicted 20550 numGC 179 limit 32.00 GB alloc 33.51 GB totalAlloc 1035.19 GB
INFO  dynacache: adjusted partitions' max size evicted 21628 numGC 180 limit 32.00 GB alloc 32.68 GB totalAlloc 1050.02 GB
INFO  dynacache: adjusted partitions' max size evicted 25156 numGC 183 limit 32.00 GB alloc 35.47 GB totalAlloc 1100.66 GB
INFO  dynacache: adjusted partitions' max size evicted 25165 numGC 183 limit 32.00 GB alloc 40.48 GB totalAlloc 1105.66 GB
INFO  dynacache: adjusted partitions' max size evicted 22579 numGC 186 limit 32.00 GB alloc 39.58 GB totalAlloc 1159.81 GB
INFO  dynacache: adjusted partitions' max size evicted 2999 numGC 190 limit 32.00 GB alloc 32.82 GB totalAlloc 1223.77 GB
INFO  dynacache: adjusted partitions' max size evicted 15445 numGC 191 limit 32.00 GB alloc 37.34 GB totalAlloc 1244.61 GB
INFO  dynacache: adjusted partitions' max size evicted 25160 numGC 193 limit 32.00 GB alloc 33.57 GB totalAlloc 1277.42 GB
INFO  dynacache: adjusted partitions' max size evicted 12810 numGC 194 limit 32.00 GB alloc 32.21 GB totalAlloc 1291.62 GB
INFO  dynacache: adjusted partitions' max size evicted 19349 numGC 200 limit 32.00 GB alloc 35.66 GB totalAlloc 1406.50 GB
INFO  dynacache: adjusted partitions' max size evicted 25162 numGC 203 limit 32.00 GB alloc 36.64 GB totalAlloc 1451.52 GB
INFO  dynacache: adjusted partitions' max size evicted 25160 numGC 203 limit 32.00 GB alloc 39.53 GB totalAlloc 1454.41 GB
INFO  dynacache: adjusted partitions' max size evicted 13722 numGC 207 limit 32.00 GB alloc 34.24 GB totalAlloc 1519.42 GB
INFO  dynacache: adjusted partitions' max size evicted 15498 numGC 208 limit 32.00 GB alloc 38.06 GB totalAlloc 1540.43 GB
INFO  dynacache: adjusted partitions' max size evicted 20799 numGC 209 limit 32.00 GB alloc 33.01 GB totalAlloc 1555.32 GB
INFO  dynacache: adjusted partitions' max size evicted 19579 numGC 222 limit 32.00 GB alloc 32.06 GB totalAlloc 1733.37 GB
INFO  dynacache: adjusted partitions' max size evicted 25162 numGC 227 limit 32.00 GB alloc 32.21 GB totalAlloc 1807.95 GB
INFO  dynacache: adjusted partitions' max size evicted 1569 numGC 228 limit 32.00 GB alloc 32.96 GB totalAlloc 1822.83 GB
INFO  dynacache: adjusted partitions' max size evicted 18811 numGC 233 limit 32.00 GB alloc 32.06 GB totalAlloc 1892.29 GB
INFO  dynacache: adjusted partitions' max size evicted 23406 numGC 236 limit 32.00 GB alloc 32.22 GB totalAlloc 1937.24 GB
INFO  dynacache: adjusted partitions' max size evicted 25160 numGC 236 limit 32.00 GB alloc 33.34 GB totalAlloc 1938.36 GB
INFO  dynacache: adjusted partitions' max size evicted 19054 numGC 249 limit 32.00 GB alloc 33.60 GB totalAlloc 2116.85 GB
INFO  dynacache: adjusted partitions' max size evicted 21499 numGC 250 limit 32.00 GB alloc 35.35 GB totalAlloc 2133.06 GB
INFO  dynacache: adjusted partitions' max size evicted 21073 numGC 264 limit 32.00 GB alloc 33.00 GB totalAlloc 2379.68 GB
INFO  dynacache: adjusted partitions' max size evicted 12581 numGC 264 limit 32.00 GB alloc 34.67 GB totalAlloc 2381.36 GB
INFO  dynacache: adjusted partitions' max size evicted 25162 numGC 285 limit 32.00 GB alloc 32.71 GB totalAlloc 2692.86 GB
INFO  dynacache: adjusted partitions' max size evicted 25162 numGC 289 limit 32.00 GB alloc 32.44 GB totalAlloc 2747.19 GB
INFO  dynacache: adjusted partitions' max size evicted 25160 numGC 289 limit 32.00 GB alloc 34.01 GB totalAlloc 2748.77 GB
INFO  dynacache: adjusted partitions' max size evicted 25162 numGC 295 limit 32.00 GB alloc 33.32 GB totalAlloc 2833.31 GB
INFO  dynacache: adjusted partitions' max size evicted 25162 numGC 321 limit 32.00 GB alloc 33.06 GB totalAlloc 3301.97 GB
INFO  dynacache: adjusted partitions' max size evicted 25160 numGC 321 limit 32.00 GB alloc 34.78 GB totalAlloc 3303.69 GB
INFO  dynacache: adjusted partitions' max size evicted 25162 numGC 323 limit 32.00 GB alloc 32.50 GB totalAlloc 3332.99 GB
INFO  dynacache: adjusted partitions' max size evicted 25162 numGC 324 limit 32.00 GB alloc 32.46 GB totalAlloc 3347.76 GB
INFO  dynacache: adjusted partitions' max size evicted 25160 numGC 324 limit 32.00 GB alloc 34.09 GB totalAlloc 3349.39 GB
INFO  dynacache: adjusted partitions' max size evicted 645 numGC 325 limit 32.00 GB alloc 32.97 GB totalAlloc 3362.45 GB
INFO  dynacache: adjusted partitions' max size evicted 4229 numGC 325 limit 32.00 GB alloc 34.89 GB totalAlloc 3364.37 GB
INFO  dynacache: adjusted partitions' max size evicted 12581 numGC 325 limit 32.00 GB alloc 36.16 GB totalAlloc 3365.64 GB
INFO  dynacache: adjusted partitions' max size evicted 25162 numGC 340 limit 32.00 GB alloc 32.39 GB totalAlloc 3554.47 GB
INFO  dynacache: adjusted partitions' max size evicted 25160 numGC 340 limit 32.00 GB alloc 34.00 GB totalAlloc 3556.08 GB
INFO  dynacache: adjusted partitions' max size evicted 645 numGC 341 limit 32.00 GB alloc 33.45 GB totalAlloc 3570.83 GB
INFO  dynacache: adjusted partitions' max size evicted 15405 numGC 341 limit 32.00 GB alloc 35.31 GB totalAlloc 3572.69 GB
INFO  dynacache: adjusted partitions' max size evicted 12581 numGC 341 limit 32.00 GB alloc 37.06 GB totalAlloc 3574.44 GB
INFO  dynacache: adjusted partitions' max size evicted 23414 numGC 353 limit 32.00 GB alloc 32.02 GB totalAlloc 3733.62 GB
INFO  dynacache: adjusted partitions' max size evicted 25162 numGC 361 limit 32.00 GB alloc 34.11 GB totalAlloc 3847.68 GB
INFO  dynacache: adjusted partitions' max size evicted 25160 numGC 369 limit 32.00 GB alloc 33.19 GB totalAlloc 3986.64 GB
INFO  dynacache: adjusted partitions' max size evicted 12581 numGC 369 limit 32.00 GB alloc 35.17 GB totalAlloc 3988.61 GB
INFO  dynacache: adjusted partitions' max size evicted 25162 numGC 374 limit 32.00 GB alloc 33.15 GB totalAlloc 4056.43 GB
INFO  dynacache: adjusted partitions' max size evicted 11026 numGC 375 limit 32.00 GB alloc 32.07 GB totalAlloc 4071.71 GB
INFO  dynacache: adjusted partitions' max size evicted 25160 numGC 375 limit 32.00 GB alloc 33.31 GB totalAlloc 4072.95 GB
INFO  dynacache: adjusted partitions' max size evicted 67 numGC 376 limit 32.00 GB alloc 32.33 GB totalAlloc 4087.81 GB
INFO  dynacache: adjusted partitions' max size evicted 25162 numGC 389 limit 32.00 GB alloc 32.90 GB totalAlloc 4262.74 GB
INFO  dynacache: adjusted partitions' max size evicted 1790 numGC 390 limit 32.00 GB alloc 33.14 GB totalAlloc 4278.52 GB
INFO  dynacache: adjusted partitions' max size evicted 25160 numGC 390 limit 32.00 GB alloc 33.90 GB totalAlloc 4279.29 GB
INFO  dynacache: adjusted partitions' max size evicted 25162 numGC 409 limit 32.00 GB alloc 32.27 GB totalAlloc 4549.11 GB
INFO  dynacache: adjusted partitions' max size evicted 2491 numGC 410 limit 32.00 GB alloc 32.60 GB totalAlloc 4565.00 GB
INFO  dynacache: adjusted partitions' max size evicted 19703 numGC 415 limit 32.00 GB alloc 32.02 GB totalAlloc 4639.66 GB
INFO  dynacache: adjusted partitions' max size evicted 18141 numGC 416 limit 32.00 GB alloc 32.79 GB totalAlloc 4655.17 GB
INFO  dynacache: adjusted partitions' max size evicted 1576 numGC 417 limit 32.00 GB alloc 32.60 GB totalAlloc 4671.23 GB
INFO  dynacache: adjusted partitions' max size evicted 15461 numGC 422 limit 32.00 GB alloc 32.40 GB totalAlloc 4744.05 GB
INFO  dynacache: adjusted partitions' max size evicted 16506 numGC 433 limit 32.00 GB alloc 32.38 GB totalAlloc 4899.32 GB
INFO  dynacache: adjusted partitions' max size evicted 17431 numGC 443 limit 32.00 GB alloc 32.23 GB totalAlloc 5045.69 GB
INFO  dynacache: adjusted partitions' max size evicted 22031 numGC 454 limit 32.00 GB alloc 32.98 GB totalAlloc 5209.85 GB
INFO  dynacache: adjusted partitions' max size evicted 1362 numGC 455 limit 32.00 GB alloc 32.59 GB totalAlloc 5225.18 GB
INFO  dynacache: adjusted partitions' max size evicted 25160 numGC 455 limit 32.00 GB alloc 33.28 GB totalAlloc 5225.87 GB
INFO  dynacache: adjusted partitions' max size evicted 20940 numGC 472 limit 32.00 GB alloc 32.46 GB totalAlloc 5462.16 GB
INFO  dynacache: adjusted partitions' max size evicted 3049 numGC 473 limit 32.00 GB alloc 32.12 GB totalAlloc 5476.07 GB
INFO  dynacache: adjusted partitions' max size evicted 14826 numGC 476 limit 32.00 GB alloc 32.14 GB totalAlloc 5517.23 GB
INFO  dynacache: adjusted partitions' max size evicted 25162 numGC 481 limit 32.00 GB alloc 32.59 GB totalAlloc 5583.43 GB
INFO  dynacache: adjusted partitions' max size evicted 25160 numGC 481 limit 32.00 GB alloc 33.71 GB totalAlloc 5584.55 GB
INFO  dynacache: adjusted partitions' max size evicted 12581 numGC 481 limit 32.00 GB alloc 34.95 GB totalAlloc 5585.79 GB
INFO  dynacache: adjusted partitions' max size evicted 11912 numGC 501 limit 32.00 GB alloc 33.20 GB totalAlloc 5891.92 GB
INFO  dynacache: adjusted partitions' max size evicted 25162 numGC 517 limit 32.00 GB alloc 32.29 GB totalAlloc 6167.73 GB
INFO  dynacache: adjusted partitions' max size evicted 25160 numGC 517 limit 32.00 GB alloc 36.34 GB totalAlloc 6171.78 GB
INFO  dynacache: adjusted partitions' max size evicted 17119 numGC 533 limit 32.00 GB alloc 32.50 GB totalAlloc 6444.66 GB
INFO  dynacache: adjusted partitions' max size evicted 25162 numGC 553 limit 32.00 GB alloc 32.52 GB totalAlloc 6753.37 GB
INFO  dynacache: adjusted partitions' max size evicted 12643 numGC 554 limit 32.00 GB alloc 38.87 GB totalAlloc 6770.88 GB
INFO  dynacache: adjusted partitions' max size evicted 25161 numGC 554 limit 32.00 GB alloc 43.26 GB totalAlloc 6775.27 GB
INFO  dynacache: adjusted partitions' max size evicted 117 numGC 556 limit 32.00 GB alloc 40.14 GB totalAlloc 6819.76 GB
INFO  dynacache: adjusted partitions' max size evicted 126 numGC 558 limit 32.00 GB alloc 45.45 GB totalAlloc 6870.00 GB
INFO  dynacache: adjusted partitions' max size evicted 144 numGC 559 limit 32.00 GB alloc 42.30 GB totalAlloc 6890.45 GB
ERROR render of "page" failed: "/Users/carl/.local/share/hugo/modules/filecache/modules/pkg/mod/github.com/ouhft/docsy@v0.0.0-20240502234050-7418d2d85b16/layouts/docs/baseof.html:4:7": execute of template failed: template: docs/single.html:4:7: executing "docs/single.html" at <partial "head.html" .>: error calling partial: partial "head.html" timed out after 6m0s. This is most likely due to infinite recursion. If this is just a slow template, you can try to increase the 'timeout' config setting.
ERROR render of "section" failed: "/Users/carl/.local/share/hugo/modules/filecache/modules/pkg/mod/github.com/ouhft/docsy@v0.0.0-20240502234050-7418d2d85b16/layouts/docs/baseof.html:4:7": execute of template failed: template: docs/list.html:4:7: executing "docs/list.html" at <partial "head.html" .>: error calling partial: partial "head.html" timed out after 6m0s. This is most likely due to infinite recursion. If this is just a slow template, you can try to increase the 'timeout' config setting.
INFO  build:  step render pages 375314 content 375286 duration 1h44m15.861229553s
INFO  build:  step postProcess duration 2.497951ms

Template Metrics:

     cumulative       average       maximum
       duration      duration      duration  count  template
     ----------      --------      --------  -----  --------
  21h10m4.922886894s  15.915815139s  6m0.450380217s   4788  docs/list.html
  17h27m50.586412251s  13.224776275s  18.940322693s   4754  partials/section-index.html
  5h44m1.942047659s   54.999712ms  6m2.764101681s  375310  partials/head.html
  4h37m11.232071341s   44.886192ms  6m0.480948591s  370520  docs/single.html
  1h34m21.414417164s   15.279687ms  1m46.981834366s  370519  _default/content.html
  1h2m22.054977438s    9.971553ms  2m17.528746656s  375273  partials/reading-time.html
  20m41.671070777s    3.308714ms    3.2922546s  375273  partials/sidebar.html
  17m7.102098092s    2.736946ms  221.111917ms  375273  partials/page-meta-links.html
  4m33.206312785s       119.7µs  459.400164ms  2282421  _default/_markup/render-link.html
  2m16.738306588s     364.367µs  570.061038ms  375276  partials/navbar.html
  2m10.339130153s     347.315µs   47.754111ms  375276  partials/footer.html
  1m49.43319331s     291.607µs   89.273697ms  375276  partials/scripts.html
  1m34.075476683s      250.66µs  6.195471006s  375310  partials/head-css.html
  1m30.144044324s     240.209µs   83.164682ms  375273  partials/taxonomy_terms_clouds.html
  1m23.275616491s  1m23.275616491s  1m23.275616491s      1  _internal/_default/sitemap.xml
  1m12.271110646s     192.582µs  3.292063936s  375273  partials/sidebar-tree.html
  1m8.311997531s      60.671µs    74.85022ms  1125931  partials/_funcs/get-page-images.html
  1m6.818266072s      178.05µs   47.566005ms  375276  partials/footer/center.html
  52.950420296s     141.098µs  1.378904506s  375273  partials/taxonomy_terms_article_wrapper.html
  51.266626205s      35.526µs  366.844394ms  1443043  _internal/shortcodes/ref.html
   45.49066417s      121.22µs   75.386796ms  375273  partials/breadcrumb.html
  44.587063116s      59.406µs   38.969596ms  750547  partials/taxonomy_terms_cloud.html
  40.421355745s     107.711µs   39.813879ms  375276  partials/footer/copyright.html
  27.709997348s      36.919µs   31.605719ms  750552  partials/footer/links.html
  26.057173554s      34.717µs   1.37876756s  750546  partials/taxonomy_terms_article.html
  25.008218662s      66.639µs   22.017668ms  375276  partials/footer/left.html
  24.261286278s      64.649µs   37.487678ms  375273  partials/page-meta-lastmod.html
  21.794335019s      58.075µs   31.630752ms  375276  partials/footer/right.html
  19.610461898s      52.256µs  1.797477462s  375273  partials/toc.html
  18.601488171s      49.562µs    85.72508ms  375311  partials/outputformat.html
  14.997106498s      39.962µs   41.070455ms  375280  partials/search-input.html
   9.918637089s       26.43µs    35.48023ms  375273  partials/feedback.html
   6.805080703s  6.805080703s  6.805080703s      1  404.html
   6.790042443s  6.790042443s  6.790042443s      1  home.html
   2.060592138s        5.49µs   26.540128ms  375273  partials/version-banner.html
   1.527649191s        4.07µs   24.461538ms  375311  partials/favicons.html
   530.815151ms       1.414µs   88.795321ms  375274  partials/hooks/body-end.html
   487.446407ms  243.723203ms  405.585872ms      2  shortcodes/tabpane.html
   357.544866ms         952ns    5.011601ms  375310  partials/hooks/head-end.html
    38.817726ms    7.763545ms    9.771073ms      5  partials/scripts/mermaid.html
    27.842696ms      87.281µs    8.032563ms    319  shortcodes/tab.html
      6.10266ms     678.073µs    3.391779ms      9  shortcodes/alert.html
     1.362224ms    1.362224ms    1.362224ms      1  _default/terms.html
      740.222µs     185.055µs     356.075µs      4  _default/_markup/render-image.html
      428.302µs      71.383µs     272.502µs      6  _default/_markup/render-codeblock-mermaid.html
      237.071µs     237.071µs     237.071µs      1  _internal/_default/sitemapindex.xml
       73.808µs      36.904µs      67.113µs      2  shortcodes/pageinfo.html
       42.411µs      42.411µs      42.411µs      1  _internal/_default/robots.txt
        10.67µs       10.67µs       10.67µs      1  /js/search.js
       10.077µs      10.077µs      10.077µs      1  /js/drawio.js
        8.976µs       8.976µs       8.976µs      1  /js/plantuml.js
        7.982µs       7.982µs       7.982µs      1  /js/markmap.js

INFO  build:  duration 1h55m3.005470821s
Total in 7408362 ms
Error: error building site: render: failed to render pages: render of "section" failed: "/Users/carl/.local/share/hugo/modules/filecache/modules/pkg/mod/github.com/ouhft/docsy@v0.0.0-20240502234050-7418d2d85b16/layouts/docs/baseof.html:4:7": execute of template failed: template: docs/list.html:4:7: executing "docs/list.html" at <partial "head.html" .>: error calling partial: partial "head.html" timed out after 6m0s. This is most likely due to infinite recursion. If this is just a slow template, you can try to increase the 'timeout' config setting.

For context, there are a handful of markdown files that are > 100MB in size (index pages typically)

And for contrast in time to failure - with the default 30s timeout we get an output of

hugo --cleanDestinationDir --gc --templateMetrics --logLevel debug
Start building sites …
hugo v0.125.4+extended darwin/amd64 BuildDate=2024-04-25T13:27:26Z VendorInfo=brew

INFO  static: removing all files from destination that don't exist in static dirs
INFO  static: syncing static files to / duration 7m48.96392592s
INFO  build:  step process substep collect files 1000 files_total 1000 duration 7.648793695s
INFO  build:  step process substep collect files 9000 files_total 10000 duration 3.513989428s
INFO  build:  step process substep collect files 8000 files_total 18000 duration 3.228937676s
INFO  build:  step process substep collect files 6000 files_total 24000 duration 3.191748599s
INFO  build:  step process substep collect files 8000 files_total 32000 duration 3.119540205s
INFO  build:  step process substep collect files 9000 files_total 41000 duration 3.091342028s
INFO  build:  step process substep collect files 9000 files_total 50000 duration 3.356811095s
INFO  build:  step process substep collect files 8000 files_total 58000 duration 3.011488619s
INFO  build:  step process substep collect files 8000 files_total 66000 duration 3.055284803s
INFO  build:  step process substep collect files 9000 files_total 75000 duration 3.196727555s
INFO  build:  step process substep collect files 9000 files_total 84000 duration 3.307183752s
INFO  build:  step process substep collect files 7000 files_total 91000 duration 3.002097511s
INFO  build:  step process substep collect files 10000 files_total 101000 duration 3.315918979s
INFO  build:  step process substep collect files 9000 files_total 110000 duration 3.207801403s
INFO  build:  step process substep collect files 9000 files_total 119000 duration 3.034217956s
INFO  build:  step process substep collect files 9000 files_total 128000 duration 3.230425702s
INFO  build:  step process substep collect files 9000 files_total 137000 duration 3.164640287s
INFO  build:  step process substep collect files 6000 files_total 143000 duration 3.22460247s
INFO  build:  step process substep collect files 9000 files_total 152000 duration 3.320861481s
INFO  build:  step process substep collect files 9000 files_total 161000 duration 3.337976013s
INFO  build:  step process substep collect files 8000 files_total 169000 duration 3.26230452s
INFO  build:  step process substep collect files 8000 files_total 177000 duration 3.218191689s
INFO  build:  step process substep collect files 6000 files_total 183000 duration 3.055906774s
INFO  build:  step process substep collect files 10000 files_total 193000 duration 3.321909214s
INFO  build:  step process substep collect files 10000 files_total 203000 duration 4.029839914s
INFO  build:  step process substep collect files 10000 files_total 213000 duration 3.254529755s
INFO  build:  step process substep collect files 10000 files_total 223000 duration 3.25718851s
INFO  build:  step process substep collect files 9000 files_total 232000 duration 3.159339676s
INFO  build:  step process substep collect files 9000 files_total 241000 duration 3.173920373s
INFO  build:  step process substep collect files 9000 files_total 250000 duration 3.175231313s
INFO  build:  step process substep collect files 9000 files_total 259000 duration 3.744129789s
INFO  build:  step process substep collect files 9000 files_total 268000 duration 3.04239213s
INFO  build:  step process substep collect files 10000 files_total 278000 duration 3.197650212s
INFO  build:  step process substep collect files 9000 files_total 287000 duration 3.095022203s
INFO  build:  step process substep collect files 9000 files_total 296000 duration 3.158712106s
INFO  build:  step process substep collect files 9000 files_total 305000 duration 3.258940387s
INFO  build:  step process substep collect files 9000 files_total 314000 duration 3.043794996s
INFO  build:  step process substep collect files 9000 files_total 323000 duration 3.086085684s
INFO  build:  step process substep collect files 9000 files_total 332000 duration 3.001329609s
INFO  build:  step process substep collect files 9000 files_total 341000 duration 4.255805013s
INFO  build:  step process substep collect files 10000 files_total 351000 duration 3.120500539s
INFO  build:  step process substep collect files 10000 files_total 361000 duration 3.133034459s
INFO  build:  step process substep collect files 10000 files_total 371000 duration 3.142847953s
INFO  build:  step process substep collect files 6000 files_total 377000 duration 3.170830662s
INFO  build:  step process substep collect files 5000 files_total 382000 duration 3.562006884s
INFO  build:  step process substep collect files 5000 files_total 387000 duration 3.132904883s
INFO  build:  step process substep collect files 7000 files_total 394000 duration 3.106032683s
INFO  build:  step process substep collect files 9000 files_total 403000 duration 3.275224009s
INFO  build:  step process substep collect files 9000 files_total 412000 duration 3.075918224s
INFO  build:  step process substep collect files 9000 files_total 421000 duration 3.184624971s
INFO  build:  step process substep collect files 9000 files_total 430000 duration 3.147783124s
INFO  build:  step process substep collect files 8000 files_total 438000 duration 3.151777682s
INFO  build:  step process substep collect files 9000 files_total 447000 duration 3.060982438s
INFO  build:  step process substep collect files 9000 files_total 456000 duration 3.706935431s
INFO  build:  step process substep collect files 5000 files_total 461000 duration 3.253701642s
INFO  build:  step process substep collect files 5000 files_total 466000 duration 3.471320155s
INFO  build:  step process substep collect files 4000 files_total 470000 duration 3.16769303s
INFO  build:  step process substep collect files 4000 files_total 474000 duration 3.166497498s
INFO  build:  step process substep collect files 1855 files_total 475855 duration 1.052098765s
INFO  build:  step process duration 3m13.438092761s
INFO  build:  step assemble duration 5m51.300688679s
INFO  postcss: use config file "/Users/carl/.local/share/hugo/modules/filecache/modules/pkg/mod/github.com/ouhft/docsy@v0.0.0-20240502234050-7418d2d85b16/postcss.config.js"
INFO  dynacache: adjusted partitions' max size evicted 25801 numGC 137 limit 32.00 GB alloc 32.16 GB totalAlloc 360.06 GB
INFO  dynacache: adjusted partitions' max size evicted 25156 numGC 142 limit 32.00 GB alloc 32.71 GB totalAlloc 434.35 GB
INFO  dynacache: adjusted partitions' max size evicted 1667 numGC 143 limit 32.00 GB alloc 32.13 GB totalAlloc 449.00 GB
INFO  dynacache: adjusted partitions' max size evicted 25810 numGC 143 limit 32.00 GB alloc 33.39 GB totalAlloc 450.26 GB
INFO  dynacache: adjusted partitions' max size evicted 25156 numGC 152 limit 32.00 GB alloc 34.50 GB totalAlloc 577.63 GB
ERROR render of "page" failed: "/Users/carl/.local/share/hugo/modules/filecache/modules/pkg/mod/github.com/ouhft/docsy@v0.0.0-20240502234050-7418d2d85b16/layouts/docs/baseof.html:4:7": execute of template failed: template: docs/single.html:4:7: executing "docs/single.html" at <partial "head.html" .>: error calling partial: partial "head.html" timed out after 30s. This is most likely due to infinite recursion. If this is just a slow template, you can try to increase the 'timeout' config setting.
ERROR render of "page" failed: "/Users/carl/.local/share/hugo/modules/filecache/modules/pkg/mod/github.com/ouhft/docsy@v0.0.0-20240502234050-7418d2d85b16/layouts/docs/single.html:2:3": execute of template failed: template: docs/single.html:2:3: executing "main" at <.Render>: error calling Render: "/Users/carl/Projects/pages.oxnet/epr/catalogue/catalogue-repo/docs/content/en/codes/14003/23829480.md:1:1": failed to execute template _default/content.html: "/Users/carl/.local/share/hugo/modules/filecache/modules/pkg/mod/github.com/ouhft/docsy@v0.0.0-20240502234050-7418d2d85b16/layouts/_default/content.html:7:6": execute of template failed: template: _default/content.html:7:6: executing "_default/content.html" at <partial "reading-time.html" .>: error calling partial: partial "reading-time.html" timed out after 30s. This is most likely due to infinite recursion. If this is just a slow template, you can try to increase the 'timeout' config setting.
INFO  build:  step render pages 31117 content 31114 duration 10m48.287237943s
INFO  build:  step postProcess duration 17.496µs
INFO  dynacache: adjusted partitions' max size evicted 25165 numGC 169 limit 32.00 GB alloc 38.73 GB totalAlloc 870.26 GB

Template Metrics:

     cumulative       average       maximum
       duration      duration      duration  count  template
     ----------      --------      --------  -----  --------
  2h2m25.187322508s  12.620596774s  30.006067005s    582  docs/list.html
  2h0m47.097170875s  12.473489106s  15.004109465s    581  partials/section-index.html
  45m47.423999711s   89.993907ms  1m0.037706336s  30529  docs/single.html
  22m15.461898798s   42.943658ms  3.762890544s  31098  partials/sidebar.html
  17m7.141645536s   33.012201ms  30.025324823s  31114  partials/head.html
  6m4.479804134s     11.9435ms  30.019618643s  30517  _default/content.html
  5m50.445963094s   11.269083ms  30.018919881s  31098  partials/reading-time.html
  1m32.561675594s  1m32.561675594s  1m32.561675594s      1  _internal/_default/sitemap.xml
  1m14.58550713s    2.397168ms  4.999019699s  31114  partials/head-css.html
  1m10.460357027s    2.265752ms  166.423529ms  31098  partials/page-meta-links.html
  1m6.472054853s    2.137502ms  3.012849511s  31098  partials/sidebar-tree.html
  23.511499377s     114.953µs   36.787613ms  204530  _default/_markup/render-link.html
  17.658412507s     567.776µs   523.15897ms  31101  partials/navbar.html
   9.974244984s     320.756µs   18.750276ms  31096  partials/footer.html
    8.73397797s     280.853µs  1.295364518s  31098  partials/taxonomy_terms_article_wrapper.html
   8.407542254s     270.373µs   32.341784ms  31096  partials/scripts.html
   6.911772516s     222.257µs   32.237605ms  31098  partials/taxonomy_terms_clouds.html
   6.699699822s     107.719µs  1.295250457s  62196  partials/taxonomy_terms_article.html
   5.543943279s  5.543943279s  5.543943279s      1  home.html
   5.539257995s  5.539257995s  5.539257995s      1  404.html
   5.131868474s     165.033µs   13.872446ms  31096  partials/footer/center.html
   5.096197818s      54.597µs   10.391149ms  93342  partials/_funcs/get-page-images.html
   4.057968704s      19.842µs   47.468445ms  204506  _internal/shortcodes/ref.html
   3.480035519s      55.951µs   32.059075ms  62197  partials/taxonomy_terms_cloud.html
    3.41457571s       109.8µs   16.616534ms  31098  partials/breadcrumb.html
   3.093479271s      99.481µs     8.48751ms  31096  partials/footer/copyright.html
   2.074155535s       33.35µs    3.332749ms  62192  partials/footer/links.html
   1.950360453s      62.726µs    89.56442ms  31093  partials/page-meta-lastmod.html
   1.877394445s      60.374µs    2.328164ms  31096  partials/footer/left.html
   1.681252952s      54.066µs   18.387016ms  31096  partials/footer/right.html
   1.430847318s      45.987µs    12.70954ms  31114  partials/outputformat.html
   1.113937403s      35.813µs    5.815274ms  31104  partials/search-input.html
   1.102415349s      35.449µs    12.71467ms  31098  partials/toc.html
    746.05759ms      23.994µs    4.592711ms  31093  partials/feedback.html
   151.722754ms       4.878µs    1.465708ms  31098  partials/version-banner.html
   103.572153ms       3.328µs    1.143728ms  31114  partials/favicons.html
    44.196073ms       1.421µs   13.734466ms  31094  partials/hooks/body-end.html
    25.109449ms         807ns    1.825584ms  31114  partials/hooks/head-end.html
    12.659225ms    2.531845ms    3.175458ms      5  partials/scripts/mermaid.html
     1.733465ms    1.733465ms    1.733465ms      1  _default/terms.html
      728.149µs     104.021µs     186.994µs      7  shortcodes/alert.html
      458.238µs     114.559µs     209.831µs      4  _default/_markup/render-image.html
      251.689µs      41.948µs     127.438µs      6  _default/_markup/render-codeblock-mermaid.html
      169.012µs     169.012µs     169.012µs      1  _internal/_default/sitemapindex.xml
       74.956µs      37.478µs       68.28µs      2  shortcodes/pageinfo.html
       19.951µs      19.951µs      19.951µs      1  _internal/_default/robots.txt
        9.322µs       9.322µs       9.322µs      1  /js/search.js
        5.759µs       5.759µs       5.759µs      1  /js/drawio.js
        5.587µs       5.587µs       5.587µs      1  /js/markmap.js
        5.564µs       5.564µs       5.564µs      1  /js/plantuml.js

INFO  build:  duration 19m53.057340586s
Total in 1662314 ms
Error: error building site: render: failed to render pages: render of "section" failed: "/Users/carl/.local/share/hugo/modules/filecache/modules/pkg/mod/github.com/ouhft/docsy@v0.0.0-20240502234050-7418d2d85b16/layouts/docs/baseof.html:4:7": execute of template failed: template: docs/list.html:4:7: executing "docs/list.html" at <partial "head.html" .>: error calling partial: partial "head.html" timed out after 30s. This is most likely due to infinite recursion. If this is just a slow template, you can try to increase the 'timeout' config setting.

.... which to me reads the same, but smaller delays.

Can anyone recommend some strategies to help me diagnose where the base issue lies please?

fekete-robert · 2024-05-03T11:04:56Z

fekete-robert
May 3, 2024
Collaborator

Probably not related, but I had a similar (infinite recursion) error a few years back when I had a shortcode that automatically generated an xref to another page, and in a corner case it failed because there were two pages referring to each other, and both was waiting for the other one to finish building.
Maybe you have something similar, stuff that is circularly depending on each other.

The way I'd try to triangulate the error is:

Delete most of your content to verify that the build is finishing for a single page or section so that you know the error is not in the template/theme.
Gradually add content back to check if a specific page or section is breaking the build.

Alternatively, you can try to remove stuff from the templates (like head.html) to see if anyhing there is causing the build to fail.

2 replies

marshalc May 3, 2024
Author

Certainly there's a lot of cross linking between pages (back and forth for many indexes and sub-pages) - it's rather a key point of the output, but I would have hoped this would be easily handled. Not sure how I may be able to adjust to test that, but thank you.

fekete-robert May 3, 2024
Collaborator

It depends how you are doing it - regular links/relrefs and similar stock solutions work as expected, custom ones (like our xref shortcode) might have unexpected side effects.

deining · 2024-05-03T12:33:47Z

deining
May 3, 2024
Collaborator

Probably also not related, but I had a similar (infinite recursion) error a while back when I used function resources.GetRemote inside a shortcode and the remote resource didn't answer in a timely fashioned manner.
Side note: I saw you asked on the Hugo forum before. Consider posting your question there, too. For me this is the better place to ask question like yours above.

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Build failed "likely due to infinite recursion" - 0.10.0 + 0.125.4 + 0.5 million files... #1988

{{title}}

Replies: 2 comments 2 replies

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

Build failed "likely due to infinite recursion" - 0.10.0 + 0.125.4 + 0.5 million files... #1988

marshalc May 3, 2024

Replies: 2 comments · 2 replies

fekete-robert May 3, 2024 Collaborator

marshalc May 3, 2024 Author

fekete-robert May 3, 2024 Collaborator

deining May 3, 2024 Collaborator

marshalc
May 3, 2024

Replies: 2 comments 2 replies

fekete-robert
May 3, 2024
Collaborator

marshalc May 3, 2024
Author

fekete-robert May 3, 2024
Collaborator

deining
May 3, 2024
Collaborator