Hello,
I’ve just installed rhodecode-ce using rcstack, and also created a subgroup and SVN repository inside. When trying to create a file or upload one using the UI, I’m getting “Error occurred during commit”. Checking Docker logs shows:
ImportError: No module named _sysconfigdata_nd
I’m assuming this is a problem inside some of the docker images? Not sure if some configuration might be missing, although I followed “rcstack get-started”
Thanks in advance.
Can you post a detailed exception please?
what is the docker image you’re using ?
Please list the output from ./rcstack image-info --verbose
Hi, sure. The full stack is:
error occurred handling this request.
Path: `/svn`, tb: Traceback (most recent call last):
File \"/nix/store/bddwfk2lcqcmmpwpss2n28ilqsicvgl9-python2.7-rhodecode-vcsserver-4.28.0/lib/python2.7/site-packages/vcsserver/http_main.py\", line 347, in vcs_view
resp = getattr(remote, method)(*args, **kwargs)
File \"/nix/store/bddwfk2lcqcmmpwpss2n28ilqsicvgl9-python2.7-rhodecode-vcsserver-4.28.0/lib/python2.7/site-packages/vcsserver/svn.py\", line 446, in commit
commit_id = svn.repos.fs_commit_txn(repo, txn)
File \"/nix/store/xwdxx7wwdwy5qwp9fjl0ih06zg2rs22b-subversion-1.13.0/lib/python2.7/site-packages/libsvn/repos.py\", line 655, in svn_repos_fs_commit_txn
return _repos.svn_repos_fs_commit_txn(*args)
SubversionException: 165001 - Commit blocked by pre-commit hook (exit code 1) with output:
Traceback (most recent call last):
File \"/nix/store/i5djb04wjk7c72s0p7gda4nf2n6z410h-python2.7-setuptools-38.4.0/lib/python2.7/site-packages/site.py\", line 73, in <module>
__boot()
File \"/nix/store/i5djb04wjk7c72s0p7gda4nf2n6z410h-python2.7-setuptools-38.4.0/lib/python2.7/site-packages/site.py\", line 34, in __boot
imp.load_module('site', stream, path, descr)
File \"/usr/lib/python2.7/site.py\", line 554, in <module>
main()
File \"/usr/lib/python2.7/site.py\", line 536, in main
known_paths = addusersitepackages(known_paths)
File \"/usr/lib/python2.7/site.py\", line 272, in addusersitepackages
user_site = getusersitepackages()
File \"/usr/lib/python2.7/site.py\", line 247, in getusersitepackages
user_base = getuserbase() # this will also set USER_BASE
File \"/usr/lib/python2.7/site.py\", line 237, in getuserbase
USER_BASE = get_config_var('userbase')
File \"/usr/lib/python2.7/sysconfig.py\", line 587, in get_config_var
return get_config_vars().get(name)
File \"/usr/lib/python2.7/sysconfig.py\", line 533, in get_config_vars
_init_posix(_CONFIG_VARS)
File \"/usr/lib/python2.7/sysconfig.py\", line 417, in _init_posix
from _sysconfigdata import build_time_vars
File \"/usr/lib/python2.7/_sysconfigdata.py\", line 6, in <module>
from _sysconfigdata_nd import *
ImportError: No module named _sysconfigdata_nd
As for that command, there is no image-info on the rcstack command.
And the image I’m using is rhodecode/rhodecode-ce:4.28.0.
Can you try using:
Just set in .custom/.runtime.env RC_VERSION=4.28.0.REL.2023.04.05.1
and then re-deploy the whole stack
Not sure if there is a better way, but I changed the version, then ran rcstack stack-upgrade rhodecode and just got some exceptions (that I’ll attach at the end) but that seemed to work after doing stack down/up.
By the way, is there a way I can do that with normal docker compose/swarm commands, instead of using your script?
Anyway, thanks for your help. I’m attaching that stacktrace in case it helps.
Pulling new image: rhodecode/rhodecode-ce:"4.28.0.REL.2023.04.05.1"
WARNING: We are about to start downloading the RhodeCode base image
This process may take anywhere between a few minutes to an hour, depending on your network speed
running: docker pull -q rhodecode/rhodecode-ce:"4.28.0.REL.2023.04.05.1"
docker.io/rhodecode/rhodecode-ce:4.28.0.REL.2023.04.05.1
Found 1 services for vcsserver
existing docker-ids: e6413a3c5dc5
Scaling to 2x (2 total) containers for vcsserver
[+] Running 1/2
✔ Container rc_cluster_apps-vcsserver-2 Running 0.0s
⠿ Container rc_cluster_apps-vcsserver-3 Starting 0.8s
Error response from daemon: failed to create task for container: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error running hook #0: error running hook: exit status 2, stdout: , stderr: runtime/cgo: pthread_create failed: Resource temporarily unavailable
SIGABRT: abort
PC=0x7fbafde9303b m=5 sigcode=18446744073709551610
goroutine 0 [idle]:
runtime: g 0: unknown pc 0x7fbafde9303b
stack: frame={sp:0x7fbad4ea1670, fp:0x0} stack=[0x7fbad46a2100,0x7fbad4ea1d00)
0x00007fbad4ea1570: 0x0000000000000000 0x0000000000000000
0x00007fbad4ea1580: 0x0000000000000000 0x0000000000000000
0x00007fbad4ea1590: 0x0000000000000000 0x0000000000000000
0x00007fbad4ea15a0: 0x0000000000000000 0x0000000000000000
0x00007fbad4ea15b0: 0x0000000000000000 0x0000000000000000
0x00007fbad4ea15c0: 0xffffffffffffffff 0xffffffffffffffff
0x00007fbad4ea15d0: 0xffffffffffffffff 0xffffffffffffffff
0x00007fbad4ea15e0: 0x000000c00033be60 0x000000c00033be90
0x00007fbad4ea15f0: 0x0000000000001000 0x0000000000000000
0x00007fbad4ea1600: 0x000000c00033bf20 0x000000c00033bf50
0x00007fbad4ea1610: 0x000000c00033bf80 0x000000c00033bfb0
0x00007fbad4ea1620: 0x000000c00033c180 0x000000c00033c1b0
0x00007fbad4ea1630: 0x000000c00033c1e0 0x000000c00033c210
0x00007fbad4ea1640: 0x000000c00033c240 0x000000c00033c270
0x00007fbad4ea1650: 0x000000c00033c2a0 0x000000c00033c2d0
0x00007fbad4ea1660: 0x000000c00033c300 0x000000c00033c330
0x00007fbad4ea1670: <0x0000000000000000 0x000000c00033c390
0x00007fbad4ea1680: 0x000000c00033c3c0 0x000000c00033c3f0
0x00007fbad4ea1690: 0x0000000000000000 0x0000000000000000
0x00007fbad4ea16a0: 0x0000000000000000 0x0000000000000000
0x00007fbad4ea16b0: 0x0000000000000000 0x0000000000000000
0x00007fbad4ea16c0: 0x0000000000000000 0x0000000000000000
0x00007fbad4ea16d0: 0x0000000000000000 0x0000000000000000
0x00007fbad4ea16e0: 0x0000000000000000 0x0000000000000000
0x00007fbad4ea16f0: 0xfffffffe7fffffff 0xffffffffffffffff
0x00007fbad4ea1700: 0xffffffffffffffff 0xffffffffffffffff
0x00007fbad4ea1710: 0xffffffffffffffff 0xffffffffffffffff
0x00007fbad4ea1720: 0xffffffffffffffff 0xffffffffffffffff
0x00007fbad4ea1730: 0xffffffffffffffff 0xffffffffffffffff
0x00007fbad4ea1740: 0xffffffffffffffff 0xffffffffffffffff
0x00007fbad4ea1750: 0xffffffffffffffff 0xffffffffffffffff
0x00007fbad4ea1760: 0xffffffffffffffff 0xffffffffffffffff
runtime: g 0: unknown pc 0x7fbafde9303b
stack: frame={sp:0x7fbad4ea1670, fp:0x0} stack=[0x7fbad46a2100,0x7fbad4ea1d00)
0x00007fbad4ea1570: 0x0000000000000000 0x0000000000000000
0x00007fbad4ea1580: 0x0000000000000000 0x0000000000000000
0x00007fbad4ea1590: 0x0000000000000000 0x0000000000000000
0x00007fbad4ea15a0: 0x0000000000000000 0x0000000000000000
0x00007fbad4ea15b0: 0x0000000000000000 0x0000000000000000
0x00007fbad4ea15c0: 0xffffffffffffffff 0xffffffffffffffff
0x00007fbad4ea15d0: 0xffffffffffffffff 0xffffffffffffffff
0x00007fbad4ea15e0: 0x000000c00033be60 0x000000c00033be90
0x00007fbad4ea15f0: 0x0000000000001000 0x0000000000000000
0x00007fbad4ea1600: 0x000000c00033bf20 0x000000c00033bf50
0x00007fbad4ea1610: 0x000000c00033bf80 0x000000c00033bfb0
0x00007fbad4ea1620: 0x000000c00033c180 0x000000c00033c1b0
0x00007fbad4ea1630: 0x000000c00033c1e0 0x000000c00033c210
0x00007fbad4ea1640: 0x000000c00033c240 0x000000c00033c270
0x00007fbad4ea1650: 0x000000c00033c2a0 0x000000c00033c2d0
0x00007fbad4ea1660: 0x000000c00033c300 0x000000c00033c330
0x00007fbad4ea1670: <0x0000000000000000 0x000000c00033c390
0x00007fbad4ea1680: 0x000000c00033c3c0 0x000000c00033c3f0
0x00007fbad4ea1690: 0x0000000000000000 0x0000000000000000
0x00007fbad4ea16a0: 0x0000000000000000 0x0000000000000000
0x00007fbad4ea16b0: 0x0000000000000000 0x0000000000000000
0x00007fbad4ea16c0: 0x0000000000000000 0x0000000000000000
0x00007fbad4ea16d0: 0x0000000000000000 0x0000000000000000
0x00007fbad4ea16e0: 0x0000000000000000 0x0000000000000000
0x00007fbad4ea16f0: 0xfffffffe7fffffff 0xffffffffffffffff
0x00007fbad4ea1700: 0xffffffffffffffff 0xffffffffffffffff
0x00007fbad4ea1710: 0xffffffffffffffff 0xffffffffffffffff
0x00007fbad4ea1720: 0xffffffffffffffff 0xffffffffffffffff
0x00007fbad4ea1730: 0xffffffffffffffff 0xffffffffffffffff
0x00007fbad4ea1740: 0xffffffffffffffff 0xffffffffffffffff
0x00007fbad4ea1750: 0xffffffffffffffff 0xffffffffffffffff
0x00007fbad4ea1760: 0xffffffffffffffff 0xffffffffffffffff
goroutine 1 [chan receive, locked to thread]:
runtime.gopark(0xc00099f438?, 0x55c4d941b185?, 0xe0?, 0xa1?, 0xc00099f450?)
/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc00099f3d0 sp=0xc00099f3b0 pc=0x55c4d944b2b6
runtime.chanrecv(0xc000118240, 0xc00099f558, 0x1)
/usr/local/go/src/runtime/chan.go:583 +0x49d fp=0xc00099f460 sp=0xc00099f3d0 pc=0x55c4d941401d
runtime.chanrecv2(0xc00099f648?, 0xa?)
/usr/local/go/src/runtime/chan.go:447 +0x18 fp=0xc00099f488 sp=0xc00099f460 pc=0x55c4d9413b58
github.com/docker/docker/vendor/github.com/prometheus/client_golang/prometheus.(*Registry).Register(0xc00086e870, {0x55c4dba6a208?, 0xc0005263b8?})
/go/src/github.com/docker/docker/vendor/github.com/prometheus/client_golang/prometheus/registry.go:291 +0x250 fp=0xc00099f7f0 sp=0xc00099f488 pc=0x55c4d9a4d450
github.com/docker/docker/vendor/github.com/prometheus/client_golang/prometheus.(*Registry).MustRegister(0x55c4d9e4238f?, {0xc000116060?, 0x1, 0xc000946bd0?})
/go/src/github.com/docker/docker/vendor/github.com/prometheus/client_golang/prometheus/registry.go:405 +0x65 fp=0xc00099f830 sp=0xc00099f7f0 pc=0x55c4d9a4e285
github.com/docker/docker/vendor/github.com/prometheus/client_golang/prometheus.MustRegister(...)
/go/src/github.com/docker/docker/vendor/github.com/prometheus/client_golang/prometheus/registry.go:178
github.com/docker/docker/vendor/github.com/grpc-ecosystem/go-grpc-prometheus.init.1()
/go/src/github.com/docker/docker/vendor/github.com/grpc-ecosystem/go-grpc-prometheus/server.go:30 +0x187 fp=0xc00099f860 sp=0xc00099f830 pc=0x55c4d9e3fe47
runtime.doInit(0x55c4dce5e520)
/usr/local/go/src/runtime/proc.go:6525 +0x128 fp=0xc00099f990 sp=0xc00099f860 pc=0x55c4d94587e8
runtime.doInit(0x55c4dce58420)
/usr/local/go/src/runtime/proc.go:6502 +0x71 fp=0xc00099fac0 sp=0xc00099f990 pc=0x55c4d9458731
runtime.doInit(0x55c4dce7cc00)
/usr/local/go/src/runtime/proc.go:6502 +0x71 fp=0xc00099fbf0 sp=0xc00099fac0 pc=0x55c4d9458731
runtime.doInit(0x55c4dce69a60)
/usr/local/go/src/runtime/proc.go:6502 +0x71 fp=0xc00099fd20 sp=0xc00099fbf0 pc=0x55c4d9458731
runtime.doInit(0x55c4dce73440)
/usr/local/go/src/runtime/proc.go:6502 +0x71 fp=0xc00099fe50 sp=0xc00099fd20 pc=0x55c4d9458731
runtime.doInit(0x55c4dce80f80)
/usr/local/go/src/runtime/proc.go:6502 +0x71 fp=0xc00099ff80 sp=0xc00099fe50 pc=0x55c4d9458731
runtime.main()
/usr/local/go/src/runtime/proc.go:233 +0x1d3 fp=0xc00099ffe0 sp=0xc00099ff80 pc=0x55c4d944ae33
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc00099ffe8 sp=0xc00099ffe0 pc=0x55c4d9480781
goroutine 2 [force gc (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000074fb0 sp=0xc000074f90 pc=0x55c4d944b2b6
runtime.goparkunlock(...)
/usr/local/go/src/runtime/proc.go:387
runtime.forcegchelper()
/usr/local/go/src/runtime/proc.go:305 +0xb0 fp=0xc000074fe0 sp=0xc000074fb0 pc=0x55c4d944b0f0
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000074fe8 sp=0xc000074fe0 pc=0x55c4d9480781
created by runtime.init.6
/usr/local/go/src/runtime/proc.go:293 +0x25
goroutine 3 [GC sweep wait]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000075780 sp=0xc000075760 pc=0x55c4d944b2b6
runtime.goparkunlock(...)
/usr/local/go/src/runtime/proc.go:387
runtime.bgsweep(0x0?)
/usr/local/go/src/runtime/mgcsweep.go:319 +0xde fp=0xc0000757c8 sp=0xc000075780 pc=0x55c4d9433c7e
runtime.gcenable.func1()
/usr/local/go/src/runtime/mgc.go:178 +0x26 fp=0xc0000757e0 sp=0xc0000757c8 pc=0x55c4d9428e06
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000757e8 sp=0xc0000757e0 pc=0x55c4d9480781
created by runtime.gcenable
/usr/local/go/src/runtime/mgc.go:178 +0x6b
goroutine 4 [GC scavenge wait]:
runtime.gopark(0xc00007c000?, 0x55c4db395810?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000075f70 sp=0xc000075f50 pc=0x55c4d944b2b6
runtime.goparkunlock(...)
/usr/local/go/src/runtime/proc.go:387
runtime.(*scavengerState).park(0x55c4dcee3020)
/usr/local/go/src/runtime/mgcscavenge.go:400 +0x53 fp=0xc000075fa0 sp=0xc000075f70 pc=0x55c4d9431ab3
runtime.bgscavenge(0x0?)
/usr/local/go/src/runtime/mgcscavenge.go:633 +0x65 fp=0xc000075fc8 sp=0xc000075fa0 pc=0x55c4d94320c5
runtime.gcenable.func2()
/usr/local/go/src/runtime/mgc.go:179 +0x26 fp=0xc000075fe0 sp=0xc000075fc8 pc=0x55c4d9428da6
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000075fe8 sp=0xc000075fe0 pc=0x55c4d9480781
created by runtime.gcenable
/usr/local/go/src/runtime/mgc.go:179 +0xaa
goroutine 5 [finalizer wait]:
runtime.gopark(0x1a0?, 0x55c4dcee3c80?, 0x60?, 0x78?, 0xc000074770?)
/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000074628 sp=0xc000074608 pc=0x55c4d944b2b6
runtime.runfinq()
/usr/local/go/src/runtime/mfinal.go:193 +0x107 fp=0xc0000747e0 sp=0xc000074628 pc=0x55c4d9427da7
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000747e8 sp=0xc0000747e0 pc=0x55c4d9480781
created by runtime.createfing
/usr/local/go/src/runtime/mfinal.go:163 +0x45
goroutine 6 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000076750 sp=0xc000076730 pc=0x55c4d944b2b6
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0000767e0 sp=0xc000076750 pc=0x55c4d942ab71
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000767e8 sp=0xc0000767e0 pc=0x55c4d9480781
created by runtime.gcBgMarkStartWorkers
/usr/local/go/src/runtime/mgc.go:1199 +0x25
goroutine 18 [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000070750 sp=0xc000070730 pc=0x55c4d944b2b6
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc0000707e0 sp=0xc000070750 pc=0x55c4d942ab71
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000707e8 sp=0xc0000707e0 pc=0x55c4d9480781
created by runtime.gcBgMarkStartWorkers
/usr/local/go/src/runtime/mgc.go:1199 +0x25
goroutine 34 [running]:
goroutine running on other thread; stack unavailable
created by runtime.gcBgMarkStartWorkers
/usr/local/go/src/runtime/mgc.go:1199 +0x25
goroutine 7 [GC worker (idle)]:
runtime.gopark(0x961fa2675f4?, 0x0?, 0x0?, 0x0?, 0x0?)
/usr/local/go/src/runtime/proc.go:381 +0xd6 fp=0xc000076f50 sp=0xc000076f30 pc=0x55c4d944b2b6
runtime.gcBgMarkWorker()
/usr/local/go/src/runtime/mgc.go:1275 +0xf1 fp=0xc000076fe0 sp=0xc000076f50 pc=0x55c4d942ab71
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc000076fe8 sp=0xc000076fe0 pc=0x55c4d9480781
created by runtime.gcBgMarkStartWorkers
/usr/local/go/src/runtime/mgc.go:1199 +0x25
goroutine 25 [runnable]:
github.com/docker/docker/vendor/github.com/prometheus/client_golang/prometheus.(*Registry).Register.func1()
/go/src/github.com/docker/docker/vendor/github.com/prometheus/client_golang/prometheus/registry.go:279 fp=0xc0000717e0 sp=0xc0000717d8 pc=0x55c4d9a4dd20
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1598 +0x1 fp=0xc0000717e8 sp=0xc0000717e0 pc=0x55c4d9480781
created by github.com/docker/docker/vendor/github.com/prometheus/client_golang/prometheus.(*Registry).Register
/go/src/github.com/docker/docker/vendor/github.com/prometheus/client_golang/prometheus/registry.go:279 +0x19b
rax 0x0
rbx 0x7fbad4ea2700
rcx 0xffffffffffffffff
rdx 0x0
rdi 0x2
rsi 0x7fbad4ea1670
rbp 0x7fbad4ea19c0
rsp 0x7fbad4ea1670
r8 0x0
r9 0x7fbad4ea1670
r10 0x8
r11 0x246
r12 0x55c4db3c764a
r13 0x7fbad4ea1a80
r14 0xc0001021a0
r15 0x10000
rip 0x7fbafde9303b
rflags 0x246
cs 0x33
fs 0x0
gs 0x0: unknown
These instructions worked perfectly for me. I had the same issue with the SVN repository. I had followed the instructions on the RhodeCode account portal for installing the rcstack:
mkdir docker-rhodecode && cd docker-rhodecode
curl -L -s -o rcstack https://dls.rhodecode.com/get/master && chmod +x rcstack
./rcstack get-started
This got me version 4.28.0. It would probably be best to direct the install to use the latest release for the best impression and avoid this debugging experience, as informative as it was about your troubleshooting features like the Exception Tracker.