Vsan space usage bug
Who is eating my CPU?
Everyday at some given times I see a peack in the use of CPU in a vSphere 5.5 infrastructure based on 4 ESXi 5.5 servers.
I am obviously investigating VM activities but up to now I did not discover anything really relevant.
In the meantime, how can I detect any possible maintenance or housekeeping scheduled activity in the ESXi hosts suitable to cause the CPU peack?
Regards
marius
Hardware health monitoring via command line on ESXi 5.x and later
Is there some command that I can run on the command line on an ESXi server (such as vim-cmd or esxcli) that will tell me the health status of the server? I don't need detailed information. "Healthy" or "Not Healthy" are good enough. If my script detects "Not Healthy", I'll manually take a closer look through the vSphere client or the Web GUI.
I'm running the HP custom image on the HP servers. I have the generic image on a few old Dell servers that will be replaced soon, so I'm not too concerned about those.
There is no vCenter in the environment. I have a mix of versions of ESXi (5.0, 5.5, 6.0, 6.5) due to the fact that some of the older hardware won't run with newer versions of ESXi. (The main problem being that the RAID isn't recognized.)
Thanks.
Threadripper ESXi 6.7 GPU and USB passthrough, experience progress and problems
Hello all-- thought I'd pass through (pun intended!) my experience so far getting up a multiheaded ESXi box on an AMD Threadripper platform.
Hardware:
ASRock Professional Gaming X399 motherboard
AMD Threadripper 1950x
64GB DDR4 RAM
1TB nvme m.2 drive
NVidia 1080 FE
Software:
ESXi 6.7
Windows 10 64 bit client
Steps that have worked so far:
I can get a vm with GPU passthrough working. In order to do this, I had to:
Upgrade the BIOS to the beta version (AGESA update)-- otherwise VM won't power up.
The mystical hypervisor.cpuid in the vm configuration, to avoid error 43 in the NVIDIA drivers in windows.
Edit passthru.map (I'm using d3d0, not bridge; others have used link).(On my former build not doing this yields complete host hang when restarting a VM.)
Turned on all IOMMU options, ACP , SVM in BIOS.
VM must use BIOS, otherwise hangs at Windows loading if USB passthrough is enabled.
The board has 3 USB controllers that I can see. Each appears associated with two other devices, a "nonessential device" and a platform security processor in addition to the controller itself.
I can't get the aquantia 10GB ethernet to pass through, not that I've tried very hard. It seems to get stuck at "enabled but needs to reboot" despite infinite reboots.
Current problem:
I can pass through a USB controller and it works fine. If I then shut down or reboot the VM, it hangs on windows logo when starting again. From a cold boot, no problems.
Things that haven't worked:
Changing PCIE switch mode in BIOS to Gen 2 instead of Auto.
Idea: Perhaps the USB controllers on this board (AMD Family 17H USB 3.0 controller?) also need to use d3d0 rebooting? Seems strange, but the bug is reminiscent of what the consumer NVIDIA boards do when not switched to bridge mode.
Hope my experience has been helpful to others and any advice would be much appreciated! Thanks "LT"
Host CPU and Host Memory for VMs always show 0 MHz/0 MB
Unable to install VMtools on win2012r2 guest (host - ESXi 6.5)
Unable to install VMtools on win2012r2 guest (host - ESXi 6.5)
When I try to install VMWare tools on fresh VM (just installed Win server 2012 R2)
I get an error: "Failed - The required VMware Tools ISO image does not exist or is inaccessible."
full error message:
Failed - The required VMware Tools ISO image does not exist or is inaccessible.
- Unable to install VMware Tools. An error occurred while trying to access image file "/usr/lib/vmware/isoimages/windows.iso" needed to install VMware Tools: 2 (No such file or directory). Please refer the product documentation or KB article 2129825 for details about how to get VMware Tools package for this guest operating system.
- vix error code = 21001
Démarrage impossible d'une VM sur ESXi 6.5 après conversion via VMconverter
Bonjour,
J'ai le message d'erreur suivant :
Échec du démarrage de la machine virtuelle.
Échec de la mise sous tension du module « DevicePowerOn ».
Impossible de créer un périphérique SCSI virtuel pour « scsi0:0 » (/vmfs/volumes/5b116e9c-753b0aec-06f4-801844ed2322/AGV_SRV/A05AGV-CHE01/A05AGV-CHE01.vmdk).
Type de disque non pris en charge ou non valide 2 pour « scsi0:0 ». Assurez-vous que le disque a été importé
Service "AUTO DEPLOY"
Bonjour,
A quoi sert le service "auto deploy" ?
Je recherche une description.
Cdlt,
Intel Wireless 3168NGW Stone Peak passthrough on an ASRock Threadripper X399 platform, won't enable
Hello folks,
Attempting to passthrough a wireless card to a VM under esxi 6.7. The device appears available for passthrough. If I check it, it says enabled/needs reboot, but then is not enabled (reverts to baseline) if I actually do reboot. Data below. (As an aside, the aquantia 10GBe appears STUCK on enabled/needs reboot, and multiple other passthrough devices work fine.) FWIW, I'm actually interested in using the Bluetooth to connect keyboard/mouse to the VM (I only have 3 USB hubs but need a forth, and no spare PCIE slots.)
System is an ASROCK Professional X399 with a Threadripper 1950x.
Esxi host 5.1 ping response getting fluctuate
Hello,
We have esxi upgrade activity from esxi 5.1 to esxi 6.0 u3 and in this case we are moving one by on esxi host from one VC to another vc which is version 6.
In this case we are moving VMs from distributed switch to standard switch and then adding this host to target VC.
One day we finishes adding all 8 esxi host all in standard switch with 5.1 version but suddenly on midnight one of the esxi host started loosing network connectivity.
We observed it was not consistent it comes online then again goes disconnected it happened for long time and then in the morning whenever the host comes online we moved all impacted VMs to other hots. later on the same host started working properly without doing anything from esxi end.
I dont understand why it was happened when we asked network team they said there is no issue from network end.
I have below questions:
1) why suddenly the host starred experiencing network connectivity and that is intermittently.
2)If there is hardware issue then how it solved when we upgraded to esxi 6 and moved to distributed switch.
3) Is there any issue if we move host from distributed (VSM) switch to standard switch.
4) Is there any challenges with network speed so therefore there was ping drop-out.
I feel there something wrong from network end but i cant prove, but yes we have snapshot where frequently ping response was down.
Please can you guys check and let me know something which can be identified.
Thank You,
Bharat
vSphere 6.5 custom cert upgrade from SHA1 to SHA256
Hi All
I installed custom certs in our vSphere 6.5 environment. There are 2 sites in enhanced link mode vCenter and PSC in each both with a custom cert from our local CA of SHA1 and connected SRM.
I need to upgrade these certs to SHA256. I cant find much info on the internet about it, does anyone have any experience with this and steps taken?
Thank you so much for any info
VISORFS at 106% Full - trouble adding host to vCenter
I'm trying to add a ESXi4.0 host to vCenter and am getting an error saying the agent isn't running.
When I look on the host I see the VISORFS partition is 106% full - this doen't seem right....
Is it possible to delete the message.gz files without causing an issue? Its been some time since I worked with ESXi 4.0!
Thanks!
"Find by IP" task showing every two minutes
I recently installed PowerChute Network Shutdown Appliance to monitor my cluster and noticed that now my hosts will show a "Find by IP" task every two minutes under recent tasks. I contacted APC but have yet to hear back.
Here's a screenshot:
Anyone seem this behavior before and if so, is there any action that I need to take or is this expected since the appliance is now constantly monitoring everything?
How can i change time zone in esxi 6.7?
How I change time zone in vmware esxi 6.7?
By the graphical interface it only allows to change the date and time
When I change the time via SSH, it returns to the default when I reboot the server
I saw in some forums that one can change the localtime but the esxi 6.7 does not have the folder / usr / share / zoneinfo
Has anyone ever had this problem?
Vmware 5, One datastore become inactive (unmounted)
Hello!
We use Vmware ESXi 5.0.0,1918656 and Hitachi AMS2100 fot datastores.
On 18.06.2018 one Datastore become Inactive (unmounted).
I found some problems with disk on AMS2100. After replacing failed hard disk, errors gone, and the status of raid and LUN become normal.
But in Vmware datastore still inactive. When i try to maunt, an error occurs.
Device status for this LUN is mounted
Add logs from ams and esxi
Latest Dell R730 2.80 bios breaks vMotion
Hi. We are still on v6.5U1, I think some hotfixes. And have applied the latest Dell R730 bios which mitagates variant 3 or 4 of meltdown. However any VM that powers on that host, cannot be vMotion off. Incompatibilty hardware warning given. I guess I was under the false assumption that EVC mode should have kept the cpu changes on the new Bios from propagating to the hosts? We were going to get the new Bios rolled out, and then rollout v6.5U2 vCenter, and then the v6.5U2 on the hypervisors. Now I am a bit confused as to what is going on. I may just have to attempt to revert the firmware back on this 1 host we did first. I am hoping someone can educate me. Thanks,,,
cannot connect to ESXi host
Hi;
First of all I'm completely newbie in Vmware. I was working on my project and suddenly the power went down and came back again. after that, I cannot connect to my ESXi 6.0 host. I can ping and even can connect remotely by SSH. But neither Vsphere Client nor HTTP/HTTPS work. I searched the net and found that "hostd" and "vpxa" are not running. I started the processes but after some seconds they stopped automatically. Here are commands:
[root@timaz-esxi:~] /etc/init.d/hostd status
hostd is not running.
[root@timaz-esxi:~] /etc/init.d/hostd start
Ramdisk 'hostd' with estimated size of 303MB already exists
hostd started.
[root@timaz-esxi:~] /etc/init.d/hostd status
hostd is running.
[root@timaz-esxi:~] /etc/init.d/hostd status
hostd is not running.
[root@timaz-esxi:~] /etc/init.d/vpxa status
vpxa is not running
[root@timaz-esxi:~] /etc/init.d/vpxa start
[root@timaz-esxi:~] /etc/init.d/vpxa status
vpxa is running
.
.
.
after a minute:
.
[root@timaz-esxi:~] /etc/init.d/vpxa status
vpxa is not running
[root@timaz-esxi:~] /etc/init.d/hostd status
hostd is not running.
I checked the log files and here they are:
------------------------------------------------------------------------------------------------------------------------------
[root@timaz-esxi:~] tail -f /var/log/vmkernel.log
2018-06-22T10:21:55.669Z cpu1:32788)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x1a (0x439dc081ee80, 0) to dev "mpx.vmhba1:C0:T0:L0" on path "vmhba1:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE
2018-06-22T10:22:54.617Z cpu2:34300)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x85 (0x439dc08a3c80, 34300) to dev "naa.600508e000000000e86e9fee026aaa01" on path "vmhba0:C1:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE
2018-06-22T10:22:54.617Z cpu2:34300)ScsiDeviceIO: 2651: Cmd(0x439dc08a3c80) 0x4d, CmdSN 0x5 from world 34300 to dev "naa.600508e000000000e86e9fee026aaa01" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0.
2018-06-22T10:22:54.618Z cpu2:34300)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x1a (0x439dc08a3c80, 34300) to dev "naa.600508e000000000e86e9fee026aaa01" on path "vmhba0:C1:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0. Act:NONE
2018-06-22T10:22:54.618Z cpu2:34300)ScsiDeviceIO: 2651: Cmd(0x439dc08a3c80) 0x1a, CmdSN 0x6 from world 34300 to dev "naa.600508e000000000e86e9fee026aaa01" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.
2018-06-22T10:22:54.619Z cpu2:34300)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x85 (0x439dc08a3c80, 34300) to dev "naa.600508e000000000e86e9fee026aaa01" on path "vmhba0:C1:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE
2018-06-22T10:26:55.659Z cpu1:32861)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x12 (0x439dc0873940, 0) to dev "naa.600508e000000000e86e9fee026aaa01" on path "vmhba0:C1:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0. Act:NONE
2018-06-22T10:26:55.669Z cpu2:32789)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x1a (0x439dc0873940, 0) to dev "mpx.vmhba1:C0:T0:L0" on path "vmhba1:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE
2018-06-22T10:31:55.658Z cpu2:32952)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x12 (0x439dc0886940, 0) to dev "naa.600508e000000000e86e9fee026aaa01" on path "vmhba0:C1:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x0 0x0. Act:NONE
2018-06-22T10:31:55.670Z cpu0:32787)NMP: nmp_ThrottleLogForDevice:3298: Cmd 0x1a (0x439dc0886940, 0) to dev "mpx.vmhba1:C0:T0:L0" on path "vmhba1:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE
------------------------------------------------------------------------------------------------------------------------------
[root@timaz-esxi:~] tail -f /var/log/vmkwarning.log
0:00:00:00.000 cpu0:1)WARNING: Serial: 648: Invalid serial port config: mem-mapped to addr 0x0.
2018-06-22T09:52:05.016Z cpu1:33097)WARNING: LinuxSignal: 541: ignored unexpected signal flags 0x2 (sig 17)
2018-06-22T09:52:30.431Z cpu2:33185)WARNING: ScsiScan: 1643: Failed to add path vmhba0:C0:T0:L0 : Not found
2018-06-22T09:52:31.466Z cpu2:33185)WARNING: ScsiScan: 1643: Failed to add path vmhba0:C0:T1:L0 : Not found
2018-06-22T09:52:33.319Z cpu2:33049)WARNING: NetDVS: 659: portAlias is NULL
2018-06-22T09:52:43.643Z cpu1:33353)WARNING: Supported VMs 128, Max VSAN VMs 400, SystemMemoryInGB 40
2018-06-22T09:52:43.643Z cpu1:33353)WARNING: MaxFileHandles: 3840, Prealloc 1, Prealloc limit: 32 GB, Host scaling factor: 1
2018-06-22T09:52:43.643Z cpu1:33353)WARNING: DOM memory will be preallocated.
2018-06-22T09:52:45.552Z cpu1:33409)WARNING: FTCpt: 476: Using IPv6 address to start server listener
2018-06-22T09:53:32.872Z cpu2:33042)WARNING: LinuxThread: 340: Error cloning thread: -28 (bad0081)
------------------------------------------------------------------------------------------------------------------------------
And this is what I got while trying to connect to the ESXi host with Vsphere Client:
I have many VMs on that ESXi host. How can I fix the issue or get my VMs from that ESXi host? tnx.
Migration of ESXi from OLD vCenter to New vCenter while OLD VC is down , IS it possible ?
Migration of ESXi 6.0 from OLD vCenter 6.0 to New vCenter 6.5 while OLD VC is down , IS it possible ?
ESXi installation, SSD drive not recognized.
Hello,
I'm trying desperately to install ESXi 6.7 on my mini-server but apparently my SSD is not recognized.
During the installation, I do not even have the window to propose me the installation on a disk, it starts directly in standalone on the USB key.
In addition, if I connect to the web client and I try to add a datastore, it does not offer me any disk, it's empty.
My motherboard is an Asus N3150I-C and my SSD is a PNY 120Gb CS900.
A compatibility problem? Someone sees a solution?
Thank you