Minetest mapserver [2.0.1]

[DoyleChris]

I tried the new version but im getting a error now.

Code: Select all

INFO[0000] Starting mapserver                            version=git-70ab8ee90a6513d3e0268548515755ef14fb60da
INFO[0000] Loading default colors                        filename=/colors.txt prefix=colormapping size=704248 useLocal=false
INFO[0000] Loaded default colors                         count=16108
INFO[0000] Migrating database                            filename=mapserver.sqlite prefix=mapobjectdb.sqlite
INFO[0000] Migration completed                           elapsed=26.725155ms prefix=mapobjectdb.sqlite
INFO[0000] Starting http server                          port=8080 webdev=false
INFO[0000] Starting initial rendering job
INFO[0059] Initial rendering                             elapsed=58.808028857s mapblocks=5355 progress%=11 tiles=283
runtime/cgo: pthread_create failed: Resource temporarily unavailable
SIGABRT: abort
PC=0x55db06 m=2 sigcode=4294967290

goroutine 0 [idle]:
runtime: unknown pc 0x55db06
stack: frame={sp:0x66d5b7e8, fp:0x0} stack=[0x6655c0bc,0x66d5bcbc)
66d5b768:  00000000  00000000  00000000  00000000
66d5b778:  00000000  00000000  00000000  00000000
66d5b788:  00000000  00000000  00000000  00000000
66d5b798:  00000000  00000000  00000000  00000000
66d5b7a8:  00000000  00000000  00000000  00000000
66d5b7b8:  00000000  00000000  00000000  00000000
66d5b7c8:  00000000  00000000  00000000  00000000
66d5b7d8:  00000000  00000000  00000000  00000000
66d5b7e8: <00b2cb94  00560dff  00000000  00000000
66d5b7f8:  00000000  00000000  00000000  00000000
66d5b808:  00000000  00000000  00000000  00000000
66d5b818:  00000000  00000000  00000000  00000000
66d5b828:  00000000  00000000  00000000  00000000
66d5b838:  00000000  00000000  00000000  00000000
66d5b848:  00000000  00000000  00000000  00000000
66d5b858:  00000000  00000000  00000020  00560e59
runtime: unknown pc 0x55db06
stack: frame={sp:0x66d5b7e8, fp:0x0} stack=[0x6655c0bc,0x66d5bcbc)
66d5b768:  00000000  00000000  00000000  00000000
66d5b778:  00000000  00000000  00000000  00000000
66d5b788:  00000000  00000000  00000000  00000000
66d5b798:  00000000  00000000  00000000  00000000
66d5b7a8:  00000000  00000000  00000000  00000000
66d5b7b8:  00000000  00000000  00000000  0

[BuckarooBanzay]

I tried the new version but im getting a error now.

Code: Select all

INFO[0000] Starting mapserver                            version=git-70ab8ee90a6513d3e0268548515755ef14fb60da
INFO[0000] Loading default colors                        filename=/colors.txt prefix=colormapping size=704248 useLocal=false
INFO[0000] Loaded default colors                         count=16108
INFO[0000] Migrating database                            filename=mapserver.sqlite prefix=mapobjectdb.sqlite
INFO[0000] Migration completed                           elapsed=26.725155ms prefix=mapobjectdb.sqlite
INFO[0000] Starting http server                          port=8080 webdev=false
INFO[0000] Starting initial rendering job
INFO[0059] Initial rendering                             elapsed=58.808028857s mapblocks=5355 progress%=11 tiles=283
runtime/cgo: pthread_create failed: Resource temporarily unavailable
SIGABRT: abort
PC=0x55db06 m=2 sigcode=4294967290

goroutine 0 [idle]:
runtime: unknown pc 0x55db06
stack: frame={sp:0x66d5b7e8, fp:0x0} stack=[0x6655c0bc,0x66d5bcbc)
66d5b768:  00000000  00000000  00000000  00000000
66d5b778:  00000000  00000000  00000000  00000000
66d5b788:  00000000  00000000  00000000  00000000
66d5b798:  00000000  00000000  00000000  00000000
66d5b7a8:  00000000  00000000  00000000  00000000
66d5b7b8:  00000000  00000000  00000000  00000000
66d5b7c8:  00000000  00000000  00000000  00000000
66d5b7d8:  00000000  00000000  00000000  00000000
66d5b7e8: <00b2cb94  00560dff  00000000  00000000
66d5b7f8:  00000000  00000000  00000000  00000000
66d5b808:  00000000  00000000  00000000  00000000
66d5b818:  00000000  00000000  00000000  00000000
66d5b828:  00000000  00000000  00000000  00000000
66d5b838:  00000000  00000000  00000000  00000000
66d5b848:  00000000  00000000  00000000  00000000
66d5b858:  00000000  00000000  00000020  00560e59
runtime: unknown pc 0x55db06
stack: frame={sp:0x66d5b7e8, fp:0x0} stack=[0x6655c0bc,0x66d5bcbc)
66d5b768:  00000000  00000000  00000000  00000000
66d5b778:  00000000  00000000  00000000  00000000
66d5b788:  00000000  00000000  00000000  00000000
66d5b798:  00000000  00000000  00000000  00000000
66d5b7a8:  00000000  00000000  00000000  00000000
66d5b7b8:  00000000  00000000  00000000  0

Uhm, thats a new one... :)

Can you try lowering the renderingjobs setting in the mapserver.json ?
It should default to the number of cores, but in the raspberry pi case i would set it to 1 and wait a bit longer.
The underlaying problem is probably a resource exhaustion of the system though...

[Walker]

has someone portet the mapserver for MineClone2 ?

or have created a color.txt for it ?

[BuckarooBanzay]

has someone portet the mapserver for MineClone2 ?

or have created a color.txt for it ?

You can add your own colors.txt if you create one: https://github.com/thomasrudin-mt/mapse ... .md#colors

If you do that though, can you send me that file so i can include it in the base colors.txt?

[Rafi59]

I'm trying to set up the mapserver on a test server. Everything works great but it use a lot of RAM. I have allocated 2 Gb of RAM in the VM and it uses after some hours 1,5Gb of RAM. I'm using the latest 2.0.1 version.

[Festus1965]

example / similar from here: sum 31.4 GB
- minetest itself 7.2 % - 2.26 GB (but there was no real visit since yesterday restart)
- mapserver 3.5 % - 1.13 %
depending on what is build in = no problem, the more in RAM, the faster can deliver.

[BuckarooBanzay]

I'm trying to set up the mapserver on a test server. Everything works great but it use a lot of RAM. I have allocated 2 Gb of RAM in the VM and it uses after some hours 1,5Gb of RAM. I'm using the latest 2.0.1 version.

You can tune that somewhat with the maxitems setting.
It tells how many mapblocks are held in ram:

Code: Select all

{
   "mapblockaccessor": {
      "expiretime": "15s",
      "purgetime": "30s",
      "maxitems": 5000
   }
}


Default is 5000, but you can set that even to 0 (this will increase rendering time though)

[Festus1965]

please explain "expiretime" - ? re-render as might got some change - or out of mem reread ?
"purgetime" ?
I set to 10000, sure I can go much higher, will test and post results about cpu using, also mem

[BuckarooBanzay]

please explain "expiretime" - ? re-render as might got some change - or out of mem reread ?
"purgetime" ?
I set to 10000, sure I can go much higher, will test and post results about cpu using, also mem

expiretime is the time mapblocks are held in memory after queried from the database.
Too much queries of the database would result in slight performance decrease on the database and cause some lag on the minetest server.

A few hundred (200-500) would be a safe setting in my opinion...

[Festus1965]

expiretime is the time mapblocks are held in memory after queried from the database.
Too much queries of the database would result in slight performance decrease on the database and cause some lag on the minetest server.

I changed before to

Code: Select all

{   "mapblockaccessor": {
      "expiretime": "15s",
      "purgetime": "30s",
      "maxitems": 10000    } }

nothing more used after more than 24 hours, now I am on

Code: Select all

{   "mapblockaccessor": {
      "expiretime": "60s",
      "purgetime": "300s",
      "maxitems": 10000    } }

add: - nearly same yet, with other settings

example / similar from here: sum 31.4 GB
- minetest itself 7.2 % - 2.26 GB
- mapserver 3.5 % - 1.13 GB

new:
- mts 9.1 % / 2.85 GB
- mapserver 3.4 % / 1.07 GB
but: ubuntu cache (keep writing files also in RAM) near another 60% as before, from usage settings in systemctl.conf before

[Festus1965]

{ "mapblockaccessor": {
"expiretime": "60s",
"purgetime": "300s",
"maxitems": 10000 } }

now,after have rushed around the map a lot, to activate old areas for mapping:
31.3 GB, used 22.1 GB with
(* system about 1.2 GB ... and others)
* mts 56.5 % / 17.8 GB RAM
* mapserver 6.2 % / 1.95 GB
* postgresql 3.4 % / 1.06 GB

[BuckarooBanzay]

{ "mapblockaccessor": {
"expiretime": "60s",
"purgetime": "300s",
"maxitems": 10000 } }

now,after have rushed around the map a lot, to activate old areas for mapping:
31.3 GB, used 22.1 GB with
(* system about 1.2 GB ... and others)
* mts 56.5 % / 17.8 GB RAM
* mapserver 6.2 % / 1.95 GB
* postgresql 3.4 % / 1.06 GB

Hey Festus

I think in your initial map generation were a lot of errors in mapblocks, that maybe the reason a lot of areas are "unmapped":
The mapper does the initial rendering in chunks (16x16 mapblocks or something) if any of the mapblocks has an error it skips the whole chunk...

In the incremental phase (the one you are in now) only the failing mapblocks aren't drawn not the whole chunk, so there should still be a few specs on the map that are white or greyish...

Is there any chance you can give me error messages and/or the failing mapblocks...?

[Festus1965]

Is there any chance you can give me error messages and/or the failing mapblocks...?

sure I found out is an old "chandelier" (Kronleuchter) - as soon I delete this "unknown block", it works, also "fire" out of old Wildes Land - I can live with it yet ... no hurry.