[tests][tvOS] Some System.IO tests are failing

[simonrozsival]

OS: tvOS
Architecture: arm64
Configuration: release
Runtime: mono

It appears that some System.IO tests on tvOS have been silently failing for at least a month. The #67746 bugfix removes a crash that prevented xharness from reporting the test failures properly (e.g. rolling build from 4/10 with this System.IO.Tests output).

The following tests are failing:

• DevicesPipesAndSockets.NamedPipe_ReadWrite
• DevicesPipesAndSockets.NamedPipe_ReadWrite_Async
• NamedPipeFileStreamConnectedConformanceTests.Dispose_ClosesStream
• NamedPipeFileStreamConnectedConformanceTests.Read_Eof_Returns0
• NamedPipeFileStreamConnectedConformanceTests.Disposed_ThrowsObjectDisposedException
• NamedPipeFileStreamConnectedConformanceTests.ZeroByteWrite_OtherDataReceivedSuccessfully
• NamedPipeFileStreamConnectedConformanceTests.Read_DataStoredAtDesiredOffset
• NamedPipeFileStreamConnectedConformanceTests.ReadAsync_ContinuesOnCurrentTaskSchedulerIfDesired
• NamedPipeFileStreamConnectedConformanceTests.ReadAsync_CancelPendingTask_ThrowsCancellationException
• NamedPipeFileStreamConnectedConformanceTests.Write_DataReadFromDesiredOffset
• NamedPipeFileStreamConnectedConformanceTests.ReadAsync_ContinuesOnCurrentSynchronizationContextIfDesired
• NamedPipeFileStreamConnectedConformanceTests.ArgumentValidation_ThrowsExpectedException
• NamedPipeFileStreamConnectedConformanceTests.ReadTimeout_Expires_Throws
• NamedPipeFileStreamConnectedConformanceTests.Flush_ValidOnWriteableStreamWithNoData_Success
• NamedPipeFileStreamConnectedConformanceTests.ZeroByteRead_BlocksUntilDataAvailableOrNops
• NamedPipeFileStreamConnectedConformanceTests.ReadAsync_CancelPendingValueTask_ThrowsCancellationException
• NamedPipeFileStreamConnectedConformanceTests.ReadWriteAsync_PrecanceledOperations_ThrowsCancellationException
• NamedPipeFileStreamConnectedConformanceTests.Timeout_Roundtrips
• NamedPipeFileStreamConnectedConformanceTests.ReadWrite_CustomMemoryManager_Success
• NamedPipeFileStreamConnectedConformanceTests.Flush_ValidOnReadableStream_Success
• NamedPipeFileStreamConnectedConformanceTests.ReadWriteByte_Success
• NamedPipeFileStreamConnectedConformanceTests.ReadWrite_MessagesSmallerThanReadBuffer_Success
• NamedPipeFileStreamConnectedConformanceTests.CopyToAsync_AllDataCopied
• NamedPipeFileStreamConnectedConformanceTests.ReadWrite_Success
• Directory_ExistsAsFile.FalseForNonRegularFile
• DirectoryInfo_EnumFSI_str_str.SearchPatternCaseSensitive
• FileInfo_Exists.TrueForNonRegularFile
• Directory_Delete_str_bool.ExtendedDirectoryWithSubdirectories
• Directory_Delete_str_bool.LongPathExtendedDirectory
• File_GetSetAttributesCommon.SettingInvalidAttributes_UnixExceptOSXAndFreeBSD(attributes: Hidden)
• Directory_CreateDirectory.DriveLetter_Unix
• Directory_EnumFSE_str_str_so.SearchPatternCaseSensitive
• File_ReadWriteAllBytes.ReadAllBytes_NonSeekableFileStream_InUnix
• FileInfo_GetSetAttributesCommon.SettingInvalidAttributes_UnixExceptOSXAndFreeBSD(attributes: Hidden)
• PathFile_Exists.TrueForNonRegularFile
• DirectoryInfo_Delete_bool.ExtendedDirectoryWithSubdirectories
• DirectoryInfo_Delete_bool.LongPathExtendedDirectory
• File_ReadWriteAllBytesAsync.ReadAllBytesAsync_NonSeekableFileStream_InUnix
• File_ExistsAsDirectory.FalseForNonRegularFile
• Directory_GetLogicalDrives.GetsValidDriveStrings_Unix
• DirectoryInfo_Create.DriveLetter_Unix
• DirectoryInfo_Exists.FalseForNonRegularFile
• DirectoryInfo_Delete.ExtendedDirectoryWithSubdirectories
• DirectoryInfo_Delete.LongPathExtendedDirectory
• Directory_Delete_str.ExtendedDirectoryWithSubdirectories
• Directory_Delete_str.LongPathExtendedDirectory

Tagging subscribers to this area: @dotnet/area-system-io
See info in area-owners.md if you want to be subscribed.

Issue Details

---

OS: tvOS
Architecture: arm64
Configuration: release
Runtime: mono

It appears that some System.IO tests on tvOS have been silently failing for at least a month. The #67746 bugfix removes a crash that prevented xharness from reporting the test failures properly (e.g. rolling build from 4/10 with this System.IO.Tests output).

The following tests are failing:

• DevicesPipesAndSockets.NamedPipe_ReadWrite
• DevicesPipesAndSockets.NamedPipe_ReadWrite_Async
• NamedPipeFileStreamConnectedConformanceTests.Dispose_ClosesStream
• NamedPipeFileStreamConnectedConformanceTests.Read_Eof_Returns0
• NamedPipeFileStreamConnectedConformanceTests.Disposed_ThrowsObjectDisposedException
• NamedPipeFileStreamConnectedConformanceTests.ZeroByteWrite_OtherDataReceivedSuccessfully
• NamedPipeFileStreamConnectedConformanceTests.Read_DataStoredAtDesiredOffset
• NamedPipeFileStreamConnectedConformanceTests.ReadAsync_ContinuesOnCurrentTaskSchedulerIfDesired
• NamedPipeFileStreamConnectedConformanceTests.ReadAsync_CancelPendingTask_ThrowsCancellationException
• NamedPipeFileStreamConnectedConformanceTests.Write_DataReadFromDesiredOffset
• NamedPipeFileStreamConnectedConformanceTests.ReadAsync_ContinuesOnCurrentSynchronizationContextIfDesired
• NamedPipeFileStreamConnectedConformanceTests.ArgumentValidation_ThrowsExpectedException
• NamedPipeFileStreamConnectedConformanceTests.ReadTimeout_Expires_Throws
• NamedPipeFileStreamConnectedConformanceTests.Flush_ValidOnWriteableStreamWithNoData_Success
• NamedPipeFileStreamConnectedConformanceTests.ZeroByteRead_BlocksUntilDataAvailableOrNops
• NamedPipeFileStreamConnectedConformanceTests.ReadAsync_CancelPendingValueTask_ThrowsCancellationException
• NamedPipeFileStreamConnectedConformanceTests.ReadWriteAsync_PrecanceledOperations_ThrowsCancellationException
• NamedPipeFileStreamConnectedConformanceTests.Timeout_Roundtrips
• NamedPipeFileStreamConnectedConformanceTests.ReadWrite_CustomMemoryManager_Success
• NamedPipeFileStreamConnectedConformanceTests.Flush_ValidOnReadableStream_Success
• NamedPipeFileStreamConnectedConformanceTests.ReadWriteByte_Success
• NamedPipeFileStreamConnectedConformanceTests.ReadWrite_MessagesSmallerThanReadBuffer_Success
• NamedPipeFileStreamConnectedConformanceTests.CopyToAsync_AllDataCopied
• NamedPipeFileStreamConnectedConformanceTests.ReadWrite_Success
• Directory_ExistsAsFile.FalseForNonRegularFile
• DirectoryInfo_EnumFSI_str_str.SearchPatternCaseSensitive
• FileInfo_Exists.TrueForNonRegularFile
• Directory_Delete_str_bool.ExtendedDirectoryWithSubdirectories
• Directory_Delete_str_bool.LongPathExtendedDirectory
• File_GetSetAttributesCommon.SettingInvalidAttributes_UnixExceptOSXAndFreeBSD(attributes: Hidden)
• Directory_CreateDirectory.DriveLetter_Unix
• Directory_EnumFSE_str_str_so.SearchPatternCaseSensitive
• File_ReadWriteAllBytes.ReadAllBytes_NonSeekableFileStream_InUnix
• FileInfo_GetSetAttributesCommon.SettingInvalidAttributes_UnixExceptOSXAndFreeBSD(attributes: Hidden)
• DevicesPipesAndSockets.NamedPipe_ReadWrite
• DevicesPipesAndSockets.NamedPipe_ReadWrite_Async
• NamedPipeFileStreamConnectedConformanceTests.Read_DataStoredAtDesiredOffset
• NamedPipeFileStreamConnectedConformanceTests.Flush_ValidOnWriteableStreamWithNoData_Success
• NamedPipeFileStreamConnectedConformanceTests.Disposed_ThrowsObjectDisposedException
• NamedPipeFileStreamConnectedConformanceTests.ReadTimeout_Expires_Throws
• NamedPipeFileStreamConnectedConformanceTests.ReadAsync_CancelPendingTask_ThrowsCancellationException
• NamedPipeFileStreamConnectedConformanceTests.ArgumentValidation_ThrowsExpectedException
• NamedPipeFileStreamConnectedConformanceTests.ReadAsync_ContinuesOnCurrentTaskSchedulerIfDesired
• NamedPipeFileStreamConnectedConformanceTests.CopyToAsync_AllDataCopied
• NamedPipeFileStreamConnectedConformanceTests.ReadWrite_CustomMemoryManager_Success
• NamedPipeFileStreamConnectedConformanceTests.ReadWrite_MessagesSmallerThanReadBuffer_Success
• NamedPipeFileStreamConnectedConformanceTests.Dispose_ClosesStream
• NamedPipeFileStreamConnectedConformanceTests.Write_DataReadFromDesiredOffset
• NamedPipeFileStreamConnectedConformanceTests.ZeroByteWrite_OtherDataReceivedSuccessfully
• NamedPipeFileStreamConnectedConformanceTests.ReadAsync_CancelPendingValueTask_ThrowsCancellationException
• NamedPipeFileStreamConnectedConformanceTests.ReadAsync_ContinuesOnCurrentSynchronizationContextIfDesired
• NamedPipeFileStreamConnectedConformanceTests.ZeroByteRead_BlocksUntilDataAvailableOrNops
• NamedPipeFileStreamConnectedConformanceTests.Flush_ValidOnReadableStream_Success
• NamedPipeFileStreamConnectedConformanceTests.ReadWriteAsync_PrecanceledOperations_ThrowsCancellationException
• NamedPipeFileStreamConnectedConformanceTests.Timeout_Roundtrips
• NamedPipeFileStreamConnectedConformanceTests.Read_Eof_Returns0
• NamedPipeFileStreamConnectedConformanceTests.ReadWrite_Success
• NamedPipeFileStreamConnectedConformanceTests.ReadWriteByte_Success
• PathFile_Exists.TrueForNonRegularFile
• DirectoryInfo_Delete_bool.ExtendedDirectoryWithSubdirectories
• DirectoryInfo_Delete_bool.LongPathExtendedDirectory
• File_ReadWriteAllBytesAsync.ReadAllBytesAsync_NonSeekableFileStream_InUnix
• File_ExistsAsDirectory.FalseForNonRegularFile
• Directory_GetLogicalDrives.GetsValidDriveStrings_Unix
• DirectoryInfo_Create.DriveLetter_Unix
• DirectoryInfo_Exists.FalseForNonRegularFile
• DirectoryInfo_Delete.ExtendedDirectoryWithSubdirectories
• DirectoryInfo_Delete.LongPathExtendedDirectory
• Directory_Delete_str.ExtendedDirectoryWithSubdirectories
• Directory_Delete_str.LongPathExtendedDirectory

Author:	simonrozsival
Assignees:	-
Labels:	area-System.IO, untriaged
Milestone:	-

Tagging subscribers to 'os-tvos': @steveisok, @akoeplinger
See info in area-owners.md if you want to be subscribed.

Issue Details

---

OS: tvOS
Architecture: arm64
Configuration: release
Runtime: mono

It appears that some System.IO tests on tvOS have been silently failing for at least a month. The #67746 bugfix removes a crash that prevented xharness from reporting the test failures properly (e.g. rolling build from 4/10 with this System.IO.Tests output).

The following tests are failing:

• DevicesPipesAndSockets.NamedPipe_ReadWrite
• DevicesPipesAndSockets.NamedPipe_ReadWrite_Async
• NamedPipeFileStreamConnectedConformanceTests.Dispose_ClosesStream
• NamedPipeFileStreamConnectedConformanceTests.Read_Eof_Returns0
• NamedPipeFileStreamConnectedConformanceTests.Disposed_ThrowsObjectDisposedException
• NamedPipeFileStreamConnectedConformanceTests.ZeroByteWrite_OtherDataReceivedSuccessfully
• NamedPipeFileStreamConnectedConformanceTests.Read_DataStoredAtDesiredOffset
• NamedPipeFileStreamConnectedConformanceTests.ReadAsync_ContinuesOnCurrentTaskSchedulerIfDesired
• NamedPipeFileStreamConnectedConformanceTests.ReadAsync_CancelPendingTask_ThrowsCancellationException
• NamedPipeFileStreamConnectedConformanceTests.Write_DataReadFromDesiredOffset
• NamedPipeFileStreamConnectedConformanceTests.ReadAsync_ContinuesOnCurrentSynchronizationContextIfDesired
• NamedPipeFileStreamConnectedConformanceTests.ArgumentValidation_ThrowsExpectedException
• NamedPipeFileStreamConnectedConformanceTests.ReadTimeout_Expires_Throws
• NamedPipeFileStreamConnectedConformanceTests.Flush_ValidOnWriteableStreamWithNoData_Success
• NamedPipeFileStreamConnectedConformanceTests.ZeroByteRead_BlocksUntilDataAvailableOrNops
• NamedPipeFileStreamConnectedConformanceTests.ReadAsync_CancelPendingValueTask_ThrowsCancellationException
• NamedPipeFileStreamConnectedConformanceTests.ReadWriteAsync_PrecanceledOperations_ThrowsCancellationException
• NamedPipeFileStreamConnectedConformanceTests.Timeout_Roundtrips
• NamedPipeFileStreamConnectedConformanceTests.ReadWrite_CustomMemoryManager_Success
• NamedPipeFileStreamConnectedConformanceTests.Flush_ValidOnReadableStream_Success
• NamedPipeFileStreamConnectedConformanceTests.ReadWriteByte_Success
• NamedPipeFileStreamConnectedConformanceTests.ReadWrite_MessagesSmallerThanReadBuffer_Success
• NamedPipeFileStreamConnectedConformanceTests.CopyToAsync_AllDataCopied
• NamedPipeFileStreamConnectedConformanceTests.ReadWrite_Success
• Directory_ExistsAsFile.FalseForNonRegularFile
• DirectoryInfo_EnumFSI_str_str.SearchPatternCaseSensitive
• FileInfo_Exists.TrueForNonRegularFile
• Directory_Delete_str_bool.ExtendedDirectoryWithSubdirectories
• Directory_Delete_str_bool.LongPathExtendedDirectory
• File_GetSetAttributesCommon.SettingInvalidAttributes_UnixExceptOSXAndFreeBSD(attributes: Hidden)
• Directory_CreateDirectory.DriveLetter_Unix
• Directory_EnumFSE_str_str_so.SearchPatternCaseSensitive
• File_ReadWriteAllBytes.ReadAllBytes_NonSeekableFileStream_InUnix
• FileInfo_GetSetAttributesCommon.SettingInvalidAttributes_UnixExceptOSXAndFreeBSD(attributes: Hidden)
• PathFile_Exists.TrueForNonRegularFile
• DirectoryInfo_Delete_bool.ExtendedDirectoryWithSubdirectories
• DirectoryInfo_Delete_bool.LongPathExtendedDirectory
• File_ReadWriteAllBytesAsync.ReadAllBytesAsync_NonSeekableFileStream_InUnix
• File_ExistsAsDirectory.FalseForNonRegularFile
• Directory_GetLogicalDrives.GetsValidDriveStrings_Unix
• DirectoryInfo_Create.DriveLetter_Unix
• DirectoryInfo_Exists.FalseForNonRegularFile
• DirectoryInfo_Delete.ExtendedDirectoryWithSubdirectories
• DirectoryInfo_Delete.LongPathExtendedDirectory
• Directory_Delete_str.ExtendedDirectoryWithSubdirectories
• Directory_Delete_str.LongPathExtendedDirectory

Author:	simonrozsival
Assignees:	-
Labels:	area-System.IO, untriaged, os-tvos
Milestone:	-

[simonrozsival]

There is some overlap with #51371

[steveisok]

A lot of the failures are asserting at

runtime/src/libraries/Common/tests/TestUtilities/System/IO/FileCleanupTestBase.cs

Line 159 in 51d11eb

Assert.True(availableLength >= MinAvailableForSufficientRandomness, $"UDS prefix {prefix} length {prefix.Length} is too long");

#63877 was intended to fix these issues and it appears they did on iOSSimulator, but we got a false positive from CI when it came to devices.