Server configuration ? (mapgen slow with XEON/SSD/32Gb Ram)

[Tikilou]

Hi, i have installed Minetest 5.0.1 on a Linux server with Ubuntu 18.04 (PPA way).
Server have 32Gb of ram, 2x256Go SSD (RAID 1), XEON CPU 6 cores / 12 threads and 300Mb/s bandwith.

Problem is, there is many lags with map generation (especially underground) thoug we are only 3 players online (private beta test until it's ready) and mapgen V7, so i'm going here to ask help about it and optimize the server configuration.

I've tried emergeblocks command and tried to generate all map world but minetest server crash with this command after a little time (no backtrace/info about it in debug file even with level 4), others people seems be affected by this bug from years : link github and link forum

This is my config files :

/etc/systemd/system/minetest-server.service

Code: Select all

[Unit]
Description=Minetest multiplayer server minetest.conf server config
Documentation=man:minetestserver(6)
After=network.target
RequiresMountsFor=/var/games/minetest-server

[Service]
Restart=on-failure
User=Debian-minetest
Group=games
ExecStart=/usr/bin/minetest --server --config /etc/minetest/minetest.conf --logfile /var/log/minetest/minetest.log
StandardOutput=null

[Install]
WantedBy=multi-user.target


/var/games/minetest-server/.minetest/worlds/world/world.mt

Code: Select all

creative_mode = false
auth_backend = files
player_backend = files
gameid = minetest
enable_damage = false
backend = sqlite3
load_mod_xban2 = true
load_mod_worldedit_gui = false
load_mod_teleport_request = true
load_mod_junglegrass = true
load_mod_cottages = false
load_mod_areasprotector = true
load_mod_plasticbox = false
load_mod_invsaw = true
load_mod_inbox = true
load_mod_hotbar = true
load_mod_homedecor_i18n = true
load_mod_poisonivy = true
load_mod_streetsmod = true
load_mod_homedecor = true
load_mod_glooptest = true
load_mod_gloopblocks = true
load_mod_unifieddyes = true
load_mod_framedglass = true
load_mod_ferns = true
load_mod_dryplants = true
load_mod_led_marquee = true
load_mod_concretestairs = true
load_mod_inspector = true
load_mod_3dmushrooms = true
load_mod_extranodes = true
load_mod_unified_inventory = true
load_mod_areas = true
load_mod_locks = true
load_mod_technic_chests = true
load_mod_jumping = true
load_mod_dreambuilder_mp_extras = true
load_mod_display_blocks = true
load_mod_digistuff = true
load_mod_delineator = true
load_mod_infrastructure = true
load_mod_currency = false
load_mod_concrete = true
load_mod_bedrock = true
load_mod_blox = true
load_mod_facade = true
load_mod_castle_shields = true
load_mod_asphaltstairs = true
load_mod_castle_gates = true
load_mod_itemframes = true
load_mod_asphalt = true
load_mod_arrowboards = true
load_mod_trunks = true
load_mod_bobblocks = true
load_mod_homedecor_3d_extras = true
load_mod_mesecons_wires = true
load_mod_streetsconcrete = true
load_mod_castle_masonry = true
load_mod_moretrees = true
load_mod_basic_materials = true
load_mod_bushes = true
load_mod_manholes = true
load_mod_mesecons_button = true
load_mod_gardening = true
load_mod_biome_lib = true
load_mod_worldedit = true
load_mod_constructionarea = true
load_mod_inventory_sorter = true
load_mod_mesecons_fpga = true
load_mod_building_blocks = true
load_mod_cavestuff = true
load_mod_streetlamps = true
load_mod_streetspoles = true
load_mod_streetshotfix = true
load_mod_bushes_classic = true
load_mod_digidisplay = true
load_mod_datastorage = true
load_mod_pipeworks = true
load_mod_technic_worldgen = true
load_mod_coloredwood = true
load_mod_lavalamp = true
load_mod_labels = true
load_mod_castle_farming = true
load_mod_prefab_redo = true
load_mod_castle_lighting = true
load_mod_castle_tapestries = true
load_mod_anvil = true
load_mod_computer = true
load_mod_stained_glass = true
load_mod_lrfurn = true
load_mod_mesecons_alias = true
load_mod_crafting_bench = true
load_mod_maptools = true
load_mod_memorandum = true
load_mod_worldedit_commands = true
load_mod_mesecons = true
load_mod_fake_fire = true
load_mod_ilights = true
load_mod_mesecons_blinkyplant = true
load_mod_mesecons_commandblock = true
load_mod_molehills = true
load_mod_mesecons_detector = true
load_mod_flowers_plus = true
load_mod_mesecons_doors = true
load_mod_worldedit_shortcommands = true
load_mod_mesecons_extrawires = true
load_mod_emergencyphone = true
load_mod_mesecons_delayer = true
load_mod_mesecons_gates = true
load_mod_mesecons_hydroturbine = true
load_mod_mesecons_insulated = true
load_mod_mesecons_lamp = true
load_mod_digilines = true
load_mod_quartz = true
load_mod_item_tweaks = true
load_mod_mesecons_luacontroller = true
load_mod_vines = true
load_mod_roadsigns = true
load_mod_mesecons_materials = true
load_mod_mesecons_microcontroller = true
load_mod_mesecons_mvps = true
load_mod_mesecons_noteblock = true
load_mod_mesecons_pistons = true
load_mod_signs_lib = true
load_mod_mesecons_powerplant = true
load_mod_mesecons_pressureplates = true
load_mod_ufos = true
load_mod_caverealms = true
load_mod_mesecons_receiver = true
load_mod_mesecons_solarpanel = true
load_mod_nature_classic = true
load_mod_unifiedbricks = true
load_mod_mesecons_switch = true
load_mod_technic_cnc = true
load_mod_mesecons_torch = true
load_mod_farming = true
load_mod_mesecons_walllever = true
load_mod_misc_overrides = true
load_mod_solidcolor = true
load_mod_plantlife_i18n = true
load_mod_steelsupport = true
load_mod_moreores = true
load_mod_nixie_tubes = true
load_mod_youngtrees = true
load_mod_notice = true
load_mod_castle_storage = true
load_mod_plasmascreen = false
load_mod_replacer = true
load_mod_mesecons_stickyblocks = true
load_mod_rgblightstone = true
load_mod_technic = true
load_mod_ropes = true
load_mod_street_signs = true
load_mod_simple_streetlights = true
load_mod_campfire = true
load_mod_castle_weapons = false
load_mod_steel = true
load_mod_titanium = true
load_mod_mesecons_movestones = true
load_mod_player_textures = true
load_mod_streetsawards = true
load_mod_mesecons_lightstone = true
load_mod_trafficlight = true
load_mod_travelnet = true
load_mod_moreblocks = true
load_mod_unifiedmesecons = true
load_mod_along_shore = true
load_mod_windmill = true
load_mod_mesecons_random = true
load_mod_woodsoils = true
load_mod_underch = true
load_mod_hunger = true
load_mod_hud = true
load_mod_compost = true
load_mod_bgm = true
load_mod_diet = true
load_mod_snowdrift = true
load_mod_back = true
load_mod_nonew = true
load_mod_tpr = true
load_mod_borders = false
load_mod_toolranks = false
load_mod_toolranks_extender = false
load_mod_uchutechnic = true
load_mod_tuber_honey = true
load_mod_stonetechnic = true
load_mod_stonemese = true
load_mod_octu = true
load_mod_lightstaff = true
load_mod_gemenergy = true
load_mod_froststaff = true
load_mod_condensed = true
load_mod_compressed = true
load_mod_gravelcraft = true
load_mod_gemtools = true
load_mod_quartzmese = true
load_mod_bakedeye = true
load_mod_clementinetree = true
load_mod_cherrytree = true
load_mod_brewing = true
load_mod_lemontree = true
load_mod_u_skins = true
load_mod_hot_air_balloons = true
load_mod_vps_blocker = true
load_mod_orienteering = true
load_mod_system_time = true
load_mod_pineapple = false
load_mod_bluecheese = true
load_mod_wield3d = true
load_mod_throwing = true
load_mod_killer_nodes = true
load_mod_sling = true
load_mod_wielded_light = true
load_mod_whynot_compat = false
load_mod_bogart = false
load_mod_fs_sieve = true
load_mod_fs_core = true
load_mod_fs_tools = true
load_mod_fs_crucible = true
load_mod_fs_barrel = true
load_mod_hangglider = true
load_mod_hidename = true


/etc/minetest/minetest.conf

Code: Select all

name = Tikilou

port = 30000

bind_address = 195.154.104.66

server_name = Peaceful & Kindness

server_description = |[English/Français | Beta test. | En phase de test bêta.] Kindness world, coop', mutual aid, humanity and no specism on this server, no pvp, peacfull mobs. // Monde paisible, coopération, entraide mutuelle, humanité et pas de spécisme sur ce serveur, pas de pvp, mobs pacifiques.

server_announce = true

serverlist_url = servers.minetest.net

map-dir = /var/games/minetest-server/.minetest/worlds/world

motd = Bienvenue sur le serveur Peaceful & Kindnesss, paix et bienveillance pour tous ici. Belle journée ! :) // Welcome on the Peaceful & Kindness server, for everyone here. Have a nice day ! :)

max_users = 3

enable_pvp = false

creative_mode = false

enable_damage = true

default_privs = interact, shout, areas, home, back, zoom

strict_protocol_version_checking = false

only_peaceful_mobs = true

give_initial_stuff = false

static_spawnpoint = -749.3, 89.5, -1218.9

disallow_empty_password = true

disable_anticheat = false

enable_mapgen_debug_info = false

max_block_send_distance = 8

max_block_generate_distance = 6


time_speed = 1

year_days = 5

sqlite_synchronous = 0

ignore_world_load_errors = true

curl_timeout = 10000

num_emerge_threads = 12

enable_item_drops = false

enable_item_pickup = true

remove_items = -1

disable_fire = true

enable_mesh_cache = false

server_side_occlusion_culling = true

mg_name = v7

secure.http_mods = digistuff, vps_blocker

hidename.use_alpha = true

dedicated_server_step = 0.0001


[Festus1965]

What you call lag ? Here when 1 player goes exploring, get around 5.0 lag from server, mean 1 make all unhappy.
So is sure open server, explore the area around spawn until about 2000 nodes before, preventing from early much "exploring" lag.

Also the mapgen kind itself seam to be a reason. At the End mapgen is always lag, will never change.
check with "free -m"

So check how much cache is the system using, normally it takes 20% of RAM I changed to 80% what help a bit.
Do not use SWAP - set vm.swappiness to low 1-10 in
sysctl.conf:

vm.swappiness=1
# Improve cache management
vm.vfs_cache_pressure=50
vm.dirty_ratio = 80

at the end the CPUs seams to be full used, what mean, there is no other bottleneck like get data to slow, write it to slow, otherwise they cant work 100%.

[uwu]

You could watch system load with 'htop' while the server is running to see what's going on.

[BuckarooBanzay]

hey

technic and moretrees is a deadly combination :)

I removed/disabled the tree-generation on mapgen from the moretrees mod and sell
the saplings in a special shop because of that.
That would be a first improvement in my experience...


EDIT
Some further improvements if your server is up for a while with many players:

• check out the mesecons-luacontroller nodetimer setting, that enabled them only if someone is near them
• disable all foreceload blocks in the minetest.conf
• try to restrict quarry and forcefield placement/usage
• the pipeworks item may clog up sometimes, you can "clear" them if you remove the safefile between restarts

[paramat]

I'm not surprised it's slow with all those mods. Many of those mods are big and/or intensive and/or slow, for example moretrees (specifically anything using biome_lib) and caverealms.
Mapgen V7 has it's own massive caverns, so you don't need 'caverealms', better to use 'caverealms_lite' which adds decorations to the core mapgen's own massive caverns.
V7 has a complete biome system, moretrees is coded for mapgen V6, so you don't need that mod in non-V6 mapgens and it's somewhat incompatible with them.

> I've tried emergeblocks command and tried to generate all map world

That's too much, only emerge 'small' volumes at a time, for example 4000x4000x80 nodes (takes about 5 mins).

[Mineminer]

I'm not surprised it's slow with all those mods. Many of those mods are big and/or intensive and/or slow, for example moretrees (specifically anything using biome_lib) and caverealms.
Mapgen V7 has it's own massive caverns, so you don't need 'caverealms', better to use 'caverealms_lite' which adds decorations to the core mapgen's own massive caverns.
V7 has a complete biome system, moretrees is coded for mapgen V6, so you don't need that mod in non-V6 mapgens and it's somewhat incompatible with them.

> I've tried emergeblocks command and tried to generate all map world

That's too much, only emerge 'small' volumes at a time, for example 4000x4000x80 nodes (takes about 5 mins).

Interesting so it recommended to do emerges in small loads at once? If so how would you break a larger load up to ensure it would generate everything? Say if you would need a 8,000 radius instead for example?