v13.9.0 tarball seems to be missing `deps/zlib/contrib`

[mhart]

curl -sSL https://nodejs.org/download/release/v13.9.0/node-v13.9.0.tar.xz | \
  tar -tJ | grep "deps/zlib/contrib"

(no results)

This results in build failures, eg:

  CC(target) /home/node/node-v13.9.0/out/Release/obj.target/zlib/deps/zlib/gzclose.o
../deps/zlib/deflate.c:54:49: fatal error: contrib/optimizations/insert_string.h: No such file or directory
 #include "contrib/optimizations/insert_string.h"

[mhart]

I feel this has cropped up before with the tarball missing things (typically new directories) – there's some sort of whitelist somewhere from memory?

[mhart]

And there was talk at the time of ensuring that a source tarball build succeeded before pushing a release out – not sure where that got to

[codebytere]

@mhart hmm ty for the catch - at first blush i'm pretty sure this happened when we switched to Chromium's zlib impl in #31201

cc @mscdex, who may know more?

[mhart]

Ah yeah, happened in v12.11.0 too:

#29712

nodejs/build#1931

[richardlau]

The source tarball is built by stripping out things from the source tree:

node/Makefile

Lines 1018 to 1054 in 0c3c0e7

	$(TARBALL): release-only $(NODE_EXE) doc
	git checkout-index -a -f --prefix=$(TARNAME)/
	mkdir -p $(TARNAME)/doc/api
	cp doc/node.1 $(TARNAME)/doc/node.1
	cp -r out/doc/api/* $(TARNAME)/doc/api/
	$(RM) -r $(TARNAME)/.editorconfig
	$(RM) -r $(TARNAME)/.git*
	$(RM) -r $(TARNAME)/.mailmap
	$(RM) -r $(TARNAME)/deps/openssl/openssl/demos
	$(RM) -r $(TARNAME)/deps/openssl/openssl/doc
	$(RM) -r $(TARNAME)/deps/openssl/openssl/test
	$(RM) -r $(TARNAME)/deps/uv/docs
	$(RM) -r $(TARNAME)/deps/uv/samples
	$(RM) -r $(TARNAME)/deps/uv/test
	$(RM) -r $(TARNAME)/deps/v8/samples
	$(RM) -r $(TARNAME)/deps/v8/tools/profviz
	$(RM) -r $(TARNAME)/deps/v8/tools/run-tests.py
	$(RM) -r $(TARNAME)/deps/zlib/contrib # too big, unused
	$(RM) -r $(TARNAME)/doc/images # too big
	$(RM) -r $(TARNAME)/test*.tap
	$(RM) -r $(TARNAME)/tools/cpplint.py
	$(RM) -r $(TARNAME)/tools/eslint-rules
	$(RM) -r $(TARNAME)/tools/license-builder.sh
	$(RM) -r $(TARNAME)/tools/node_modules
	$(RM) -r $(TARNAME)/tools/osx-*
	$(RM) -r $(TARNAME)/tools/osx-pkg.pmdoc
	find $(TARNAME)/deps/v8/test/* -type d ! -regex '.*/test/torque$$' | xargs $(RM) -r
	find $(TARNAME)/deps/v8/test -type f ! -regex '.*/test/torque/.*' | xargs $(RM)
	find $(TARNAME)/ -name ".eslint*" -maxdepth 2 | xargs $(RM)
	find $(TARNAME)/ -type l | xargs $(RM) # annoying on windows
	tar -cf $(TARNAME).tar $(TARNAME)
	$(RM) -r $(TARNAME)
	gzip -c -f -9 $(TARNAME).tar > $(TARNAME).tar.gz
	ifeq ($(XZ), 1)
	xz -c -f -$(XZ_COMPRESSION) $(TARNAME).tar > $(TARNAME).tar.xz
	endif
	$(RM) $(TARNAME).tar

Up until now we exclude everything in deps/zlib/contrib:

node/Makefile

Line 1035 in 0c3c0e7

$(RM) -r $(TARNAME)/deps/zlib/contrib # too big, unused

but #31201 has changed things. Is it just contrib/optimizations that we need to add?

[mscdex]

Is it just contrib/optimizations that we need to add?

Probably.

[mhart]

Could the Makefile be modified so that all binaries are built off the result of the tarball modifications? That would catch issues like this before releases go out.