PS C:\arcus\mySparkApp> spark-submit `
>> --packages com.microsoft.azure:azure-eventhubs-spark_2.11:2.3.21 `
>> --class org.apache.spark.deploy.dotnet.DotnetRunner `
>> --master local `
>> bin\Debug\netcoreapp3.1\microsoft-spark-3-0_2.12-1.0.0.jar `
>> dotnet bin\Debug\netcoreapp3.1\mySparkApp.dll
>>
Ivy Default Cache set to: C:\Users\mwinick\.ivy2\cache
The jars for the packages stored in: C:\Users\mwinick\.ivy2\jars
:: loading settings :: url = jar:file:/C:/bin/spark-3.0.1-bin-hadoop2.7/jars/ivy-2.4.0.jar!/org/apache/ivy/core/settings/ivysettings.xml
com.microsoft.azure#azure-eventhubs-spark_2.11 added as a dependency
:: resolving dependencies :: org.apache.spark#spark-submit-parent-8a63ec2a-9f1b-4a83-8df1-5b14e3657875;1.0
        confs: [default]
        found com.microsoft.azure#azure-eventhubs-spark_2.11;2.3.21 in central
        found com.microsoft.azure#azure-eventhubs;3.3.0 in central
        found org.apache.qpid#proton-j;0.33.8 in central
        found com.microsoft.azure#qpid-proton-j-extensions;1.2.4 in central
        found org.slf4j#slf4j-api;1.7.30 in central
        found com.microsoft.azure#azure-client-authentication;1.7.3 in central
        found com.microsoft.azure#azure-client-runtime;1.7.3 in central
        found com.microsoft.rest#client-runtime;1.7.3 in central
        found com.google.guava#guava;24.1.1-jre in central
        found com.google.code.findbugs#jsr305;1.3.9 in central
        found org.checkerframework#checker-compat-qual;2.0.0 in central
        found com.google.errorprone#error_prone_annotations;2.1.3 in central
        found com.google.j2objc#j2objc-annotations;1.1 in central
        found org.codehaus.mojo#animal-sniffer-annotations;1.14 in central
        found com.squareup.retrofit2#retrofit;2.7.2 in central
        found com.squareup.okhttp3#okhttp;3.12.6 in central
        found com.squareup.okio#okio;1.15.0 in central
        found com.squareup.okhttp3#logging-interceptor;3.12.2 in central
        found com.squareup.okhttp3#okhttp-urlconnection;3.12.2 in central
        found com.squareup.retrofit2#converter-jackson;2.7.2 in central
        found com.fasterxml.jackson.core#jackson-databind;2.10.1 in central
        found com.fasterxml.jackson.core#jackson-annotations;2.10.1 in central
        found com.fasterxml.jackson.core#jackson-core;2.10.1 in central
        found com.fasterxml.jackson.datatype#jackson-datatype-joda;2.10.1 in central
        found joda-time#joda-time;2.9.9 in central
        found org.apache.commons#commons-lang3;3.4 in central
        found io.reactivex#rxjava;1.3.8 in central
        found com.squareup.retrofit2#adapter-rxjava;2.7.2 in central
        found com.microsoft.azure#azure-annotations;1.10.0 in central
        found commons-codec#commons-codec;1.11 in central
        found com.microsoft.azure#adal4j;1.6.4 in central
        found com.nimbusds#oauth2-oidc-sdk;6.5 in central
        found com.sun.mail#javax.mail;1.6.1 in central
        found javax.activation#activation;1.1 in central
        found com.github.stephenc.jcip#jcip-annotations;1.0-1 in central
        found net.minidev#json-smart;2.3 in central
        [2.3] net.minidev#json-smart;[1.3.1,2.3]
        found net.minidev#accessors-smart;1.2 in central
        found org.ow2.asm#asm;5.0.4 in central
        found com.nimbusds#lang-tag;1.5 in central
        [1.5] com.nimbusds#lang-tag;[1.4.3,)
        found com.google.code.gson#gson;2.8.0 in central
        found com.nimbusds#nimbus-jose-jwt;9.8.1 in central
        found org.scala-lang.modules#scala-java8-compat_2.11;0.9.0 in local-m2-cache
:: resolution report :: resolve 2559ms :: artifacts dl 22ms
        :: modules in use:
        com.fasterxml.jackson.core#jackson-annotations;2.10.1 from central in [default]
        com.fasterxml.jackson.core#jackson-core;2.10.1 from central in [default]
        com.fasterxml.jackson.core#jackson-databind;2.10.1 from central in [default]
        com.fasterxml.jackson.datatype#jackson-datatype-joda;2.10.1 from central in [default]
        com.github.stephenc.jcip#jcip-annotations;1.0-1 from central in [default]
        com.google.code.findbugs#jsr305;1.3.9 from central in [default]
        com.google.code.gson#gson;2.8.0 from central in [default]
        com.google.errorprone#error_prone_annotations;2.1.3 from central in [default]
        com.google.guava#guava;24.1.1-jre from central in [default]
        com.google.j2objc#j2objc-annotations;1.1 from central in [default]
        com.microsoft.azure#adal4j;1.6.4 from central in [default]
        com.microsoft.azure#azure-annotations;1.10.0 from central in [default]
        com.microsoft.azure#azure-client-authentication;1.7.3 from central in [default]
        com.microsoft.azure#azure-client-runtime;1.7.3 from central in [default]
        com.microsoft.azure#azure-eventhubs;3.3.0 from central in [default]
        com.microsoft.azure#azure-eventhubs-spark_2.11;2.3.21 from central in [default]
        com.microsoft.azure#qpid-proton-j-extensions;1.2.4 from central in [default]
        com.microsoft.rest#client-runtime;1.7.3 from central in [default]
        com.nimbusds#lang-tag;1.5 from central in [default]
        com.nimbusds#nimbus-jose-jwt;9.8.1 from central in [default]
        com.nimbusds#oauth2-oidc-sdk;6.5 from central in [default]
        com.squareup.okhttp3#logging-interceptor;3.12.2 from central in [default]
        com.squareup.okhttp3#okhttp;3.12.6 from central in [default]
        com.squareup.okhttp3#okhttp-urlconnection;3.12.2 from central in [default]
        com.squareup.okio#okio;1.15.0 from central in [default]
        com.squareup.retrofit2#adapter-rxjava;2.7.2 from central in [default]
        com.squareup.retrofit2#converter-jackson;2.7.2 from central in [default]
        com.squareup.retrofit2#retrofit;2.7.2 from central in [default]
        com.sun.mail#javax.mail;1.6.1 from central in [default]
        commons-codec#commons-codec;1.11 from central in [default]
        io.reactivex#rxjava;1.3.8 from central in [default]
        javax.activation#activation;1.1 from central in [default]
        joda-time#joda-time;2.9.9 from central in [default]
        net.minidev#accessors-smart;1.2 from central in [default]
        net.minidev#json-smart;2.3 from central in [default]
        org.apache.commons#commons-lang3;3.4 from central in [default]
        org.apache.qpid#proton-j;0.33.8 from central in [default]
        org.checkerframework#checker-compat-qual;2.0.0 from central in [default]
        org.codehaus.mojo#animal-sniffer-annotations;1.14 from central in [default]
        org.ow2.asm#asm;5.0.4 from central in [default]
        org.scala-lang.modules#scala-java8-compat_2.11;0.9.0 from local-m2-cache in [default]
        org.slf4j#slf4j-api;1.7.30 from central in [default]
        :: evicted modules:
        org.slf4j#slf4j-api;1.7.28 by [org.slf4j#slf4j-api;1.7.30] in [default]
        org.slf4j#slf4j-api;1.7.22 by [org.slf4j#slf4j-api;1.7.30] in [default]
        com.nimbusds#nimbus-jose-jwt;[6.0.1,) by [com.nimbusds#nimbus-jose-jwt;9.8.1] in [default]
        ---------------------------------------------------------------------
        |                  |            modules            ||   artifacts   |
        |       conf       | number| search|dwnlded|evicted|| number|dwnlded|
        ---------------------------------------------------------------------
        |      default     |   45  |   2   |   0   |   3   ||   42  |   0   |
        ---------------------------------------------------------------------
:: retrieving :: org.apache.spark#spark-submit-parent-8a63ec2a-9f1b-4a83-8df1-5b14e3657875
        confs: [default]
        0 artifacts copied, 42 already retrieved (0kB/19ms)
21/09/12 10:05:04 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
21/09/12 10:05:04 INFO DotnetRunner: Starting DotnetBackend with dotnet.
21/09/12 10:05:04 INFO DotnetBackend: The number of DotnetBackend threads is set to 10.
21/09/12 10:05:05 INFO DotnetRunner: Port number used by DotnetBackend is 58876
21/09/12 10:05:05 INFO DotnetRunner: Adding key=spark.jars and value=file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-eventhubs-spark_2.11-2.3.21.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-eventhubs-3.3.0.jar,file:///C:/Users/mwinick/.ivy2/jars/org.scala-lang.modules_scala-java8-compat_2.11-0.9.0.jar,file:///C:/Users/mwinick/.ivy2/jars/org.apache.qpid_proton-j-0.33.8.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_qpid-proton-j-extensions-1.2.4.jar,file:///C:/Users/mwinick/.ivy2/jars/org.slf4j_slf4j-api-1.7.30.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-client-authentication-1.7.3.jar,file:///C:/Users/mwinick/.ivy2/jars/com.nimbusds_nimbus-jose-jwt-9.8.1.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-client-runtime-1.7.3.jar,file:///C:/Users/mwinick/.ivy2/jars/commons-codec_commons-codec-1.11.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_adal4j-1.6.4.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-annotations-1.10.0.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.rest_client-runtime-1.7.3.jar,file:///C:/Users/mwinick/.ivy2/jars/com.google.guava_guava-24.1.1-jre.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.retrofit2_retrofit-2.7.2.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.okhttp3_okhttp-3.12.6.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.okhttp3_logging-interceptor-3.12.2.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.okhttp3_okhttp-urlconnection-3.12.2.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.retrofit2_converter-jackson-2.7.2.jar,file:///C:/Users/mwinick/.ivy2/jars/com.fasterxml.jackson.datatype_jackson-datatype-joda-2.10.1.jar,file:///C:/Users/mwinick/.ivy2/jars/org.apache.commons_commons-lang3-3.4.jar,file:///C:/Users/mwinick/.ivy2/jars/io.reactivex_rxjava-1.3.8.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.retrofit2_adapter-rxjava-2.7.2.jar,file:///C:/Users/mwinick/.ivy2/jars/com.google.code.findbugs_jsr305-1.3.9.jar,file:///C:/Users/mwinick/.ivy2/jars/org.checkerframework_checker-compat-qual-2.0.0.jar,file:///C:/Users/mwinick/.ivy2/jars/com.google.errorprone_error_prone_annotations-2.1.3.jar,file:///C:/Users/mwinick/.ivy2/jars/com.google.j2objc_j2objc-annotations-1.1.jar,file:///C:/Users/mwinick/.ivy2/jars/org.codehaus.mojo_animal-sniffer-annotations-1.14.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.okio_okio-1.15.0.jar,file:///C:/Users/mwinick/.ivy2/jars/com.fasterxml.jackson.core_jackson-databind-2.10.1.jar,file:///C:/Users/mwinick/.ivy2/jars/com.fasterxml.jackson.core_jackson-annotations-2.10.1.jar,file:///C:/Users/mwinick/.ivy2/jars/com.fasterxml.jackson.core_jackson-core-2.10.1.jar,file:///C:/Users/mwinick/.ivy2/jars/joda-time_joda-time-2.9.9.jar,file:///C:/Users/mwinick/.ivy2/jars/com.nimbusds_oauth2-oidc-sdk-6.5.jar,file:///C:/Users/mwinick/.ivy2/jars/com.google.code.gson_gson-2.8.0.jar,file:///C:/Users/mwinick/.ivy2/jars/com.sun.mail_javax.mail-1.6.1.jar,file:///C:/Users/mwinick/.ivy2/jars/com.github.stephenc.jcip_jcip-annotations-1.0-1.jar,file:///C:/Users/mwinick/.ivy2/jars/net.minidev_json-smart-2.3.jar,file:///C:/Users/mwinick/.ivy2/jars/com.nimbusds_lang-tag-1.5.jar,file:///C:/Users/mwinick/.ivy2/jars/javax.activation_activation-1.1.jar,file:///C:/Users/mwinick/.ivy2/jars/net.minidev_accessors-smart-1.2.jar,file:///C:/Users/mwinick/.ivy2/jars/org.ow2.asm_asm-5.0.4.jar,file:/C:/arcus/mySparkApp/bin/Debug/netcoreapp3.1/microsoft-spark-3-0_2.12-1.0.0.jar to environment
21/09/12 10:05:05 INFO DotnetRunner: Adding key=spark.app.name and value=org.apache.spark.deploy.dotnet.DotnetRunner to environment
21/09/12 10:05:05 INFO DotnetRunner: Adding key=spark.submit.pyFiles and value= to environment
21/09/12 10:05:05 INFO DotnetRunner: Adding key=spark.submit.deployMode and value=client to environment
21/09/12 10:05:05 INFO DotnetRunner: Adding key=spark.master and value=local to environment
21/09/12 10:05:05 INFO DotnetRunner: Adding key=spark.repl.local.jars and value=file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-eventhubs-spark_2.11-2.3.21.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-eventhubs-3.3.0.jar,file:///C:/Users/mwinick/.ivy2/jars/org.scala-lang.modules_scala-java8-compat_2.11-0.9.0.jar,file:///C:/Users/mwinick/.ivy2/jars/org.apache.qpid_proton-j-0.33.8.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_qpid-proton-j-extensions-1.2.4.jar,file:///C:/Users/mwinick/.ivy2/jars/org.slf4j_slf4j-api-1.7.30.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-client-authentication-1.7.3.jar,file:///C:/Users/mwinick/.ivy2/jars/com.nimbusds_nimbus-jose-jwt-9.8.1.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-client-runtime-1.7.3.jar,file:///C:/Users/mwinick/.ivy2/jars/commons-codec_commons-codec-1.11.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_adal4j-1.6.4.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-annotations-1.10.0.jar,file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.rest_client-runtime-1.7.3.jar,file:///C:/Users/mwinick/.ivy2/jars/com.google.guava_guava-24.1.1-jre.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.retrofit2_retrofit-2.7.2.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.okhttp3_okhttp-3.12.6.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.okhttp3_logging-interceptor-3.12.2.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.okhttp3_okhttp-urlconnection-3.12.2.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.retrofit2_converter-jackson-2.7.2.jar,file:///C:/Users/mwinick/.ivy2/jars/com.fasterxml.jackson.datatype_jackson-datatype-joda-2.10.1.jar,file:///C:/Users/mwinick/.ivy2/jars/org.apache.commons_commons-lang3-3.4.jar,file:///C:/Users/mwinick/.ivy2/jars/io.reactivex_rxjava-1.3.8.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.retrofit2_adapter-rxjava-2.7.2.jar,file:///C:/Users/mwinick/.ivy2/jars/com.google.code.findbugs_jsr305-1.3.9.jar,file:///C:/Users/mwinick/.ivy2/jars/org.checkerframework_checker-compat-qual-2.0.0.jar,file:///C:/Users/mwinick/.ivy2/jars/com.google.errorprone_error_prone_annotations-2.1.3.jar,file:///C:/Users/mwinick/.ivy2/jars/com.google.j2objc_j2objc-annotations-1.1.jar,file:///C:/Users/mwinick/.ivy2/jars/org.codehaus.mojo_animal-sniffer-annotations-1.14.jar,file:///C:/Users/mwinick/.ivy2/jars/com.squareup.okio_okio-1.15.0.jar,file:///C:/Users/mwinick/.ivy2/jars/com.fasterxml.jackson.core_jackson-databind-2.10.1.jar,file:///C:/Users/mwinick/.ivy2/jars/com.fasterxml.jackson.core_jackson-annotations-2.10.1.jar,file:///C:/Users/mwinick/.ivy2/jars/com.fasterxml.jackson.core_jackson-core-2.10.1.jar,file:///C:/Users/mwinick/.ivy2/jars/joda-time_joda-time-2.9.9.jar,file:///C:/Users/mwinick/.ivy2/jars/com.nimbusds_oauth2-oidc-sdk-6.5.jar,file:///C:/Users/mwinick/.ivy2/jars/com.google.code.gson_gson-2.8.0.jar,file:///C:/Users/mwinick/.ivy2/jars/com.sun.mail_javax.mail-1.6.1.jar,file:///C:/Users/mwinick/.ivy2/jars/com.github.stephenc.jcip_jcip-annotations-1.0-1.jar,file:///C:/Users/mwinick/.ivy2/jars/net.minidev_json-smart-2.3.jar,file:///C:/Users/mwinick/.ivy2/jars/com.nimbusds_lang-tag-1.5.jar,file:///C:/Users/mwinick/.ivy2/jars/javax.activation_activation-1.1.jar,file:///C:/Users/mwinick/.ivy2/jars/net.minidev_accessors-smart-1.2.jar,file:///C:/Users/mwinick/.ivy2/jars/org.ow2.asm_asm-5.0.4.jar to environment
[2021-09-12T17:05:05.9796970Z] [5CD034PMMX] [Info] [ConfigurationService] Using port 58876 for connection.
[2021-09-12T17:05:05.9922623Z] [5CD034PMMX] [Info] [JvmBridge] JvMBridge port is 58876
[2021-09-12T17:05:05.9960207Z] [5CD034PMMX] [Info] [JvmBridge] The number of JVM backend thread is set to 10. The max number of concurrent sockets in JvmBridge is set to 7.
21/09/12 10:05:06 INFO SparkContext: Running Spark version 3.0.1
21/09/12 10:05:06 INFO ResourceUtils: ==============================================================
21/09/12 10:05:06 INFO ResourceUtils: Resources for spark.driver:

21/09/12 10:05:06 INFO ResourceUtils: ==============================================================
21/09/12 10:05:06 INFO SparkContext: Submitted application: VS Telemetry processing using Spark.NET
21/09/12 10:05:06 INFO SecurityManager: Changing view acls to: mwinick
21/09/12 10:05:06 INFO SecurityManager: Changing modify acls to: mwinick
21/09/12 10:05:06 INFO SecurityManager: Changing view acls groups to:
21/09/12 10:05:06 INFO SecurityManager: Changing modify acls groups to:
21/09/12 10:05:06 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users  with view permissions: Set(mwinick); groups with view permissions: Set(); users  with modify permissions: Set(mwinick); groups with modify permissions: Set()
21/09/12 10:05:06 INFO Utils: Successfully started service 'sparkDriver' on port 58884.
21/09/12 10:05:06 INFO SparkEnv: Registering MapOutputTracker
21/09/12 10:05:06 INFO SparkEnv: Registering BlockManagerMaster
21/09/12 10:05:06 INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information
21/09/12 10:05:06 INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up
21/09/12 10:05:06 INFO SparkEnv: Registering BlockManagerMasterHeartbeat
21/09/12 10:05:06 INFO DiskBlockManager: Created local directory at C:\Users\mwinick\AppData\Local\Temp\blockmgr-adf82200-b738-4cb4-b541-66fc283a7d1f
21/09/12 10:05:06 INFO MemoryStore: MemoryStore started with capacity 407.7 MiB
21/09/12 10:05:06 INFO SparkEnv: Registering OutputCommitCoordinator
21/09/12 10:05:06 INFO Utils: Successfully started service 'SparkUI' on port 4040.
21/09/12 10:05:06 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://5CD034PMMX.tandemdiabetes.com:4040
21/09/12 10:05:06 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-eventhubs-spark_2.11-2.3.21.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.microsoft.azure_azure-eventhubs-spark_2.11-2.3.21.jar with timestamp 1631466306971
21/09/12 10:05:06 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-eventhubs-3.3.0.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.microsoft.azure_azure-eventhubs-3.3.0.jar with timestamp 1631466306971
21/09/12 10:05:06 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/org.scala-lang.modules_scala-java8-compat_2.11-0.9.0.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/org.scala-lang.modules_scala-java8-compat_2.11-0.9.0.jar with timestamp 1631466306974
21/09/12 10:05:06 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/org.apache.qpid_proton-j-0.33.8.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/org.apache.qpid_proton-j-0.33.8.jar with timestamp 1631466306980
21/09/12 10:05:06 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_qpid-proton-j-extensions-1.2.4.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.microsoft.azure_qpid-proton-j-extensions-1.2.4.jar with timestamp 1631466306981
21/09/12 10:05:06 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/org.slf4j_slf4j-api-1.7.30.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/org.slf4j_slf4j-api-1.7.30.jar with timestamp 1631466306983
21/09/12 10:05:06 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-client-authentication-1.7.3.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.microsoft.azure_azure-client-authentication-1.7.3.jar with timestamp 1631466306990
21/09/12 10:05:06 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.nimbusds_nimbus-jose-jwt-9.8.1.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.nimbusds_nimbus-jose-jwt-9.8.1.jar with timestamp 1631466306991
21/09/12 10:05:06 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-client-runtime-1.7.3.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.microsoft.azure_azure-client-runtime-1.7.3.jar with timestamp 1631466306997
21/09/12 10:05:06 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/commons-codec_commons-codec-1.11.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/commons-codec_commons-codec-1.11.jar with timestamp 1631466306999
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_adal4j-1.6.4.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.microsoft.azure_adal4j-1.6.4.jar with timestamp 1631466307012
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.azure_azure-annotations-1.10.0.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.microsoft.azure_azure-annotations-1.10.0.jar with timestamp 1631466307013
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.microsoft.rest_client-runtime-1.7.3.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.microsoft.rest_client-runtime-1.7.3.jar with timestamp 1631466307027
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.google.guava_guava-24.1.1-jre.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.google.guava_guava-24.1.1-jre.jar with timestamp 1631466307038
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.squareup.retrofit2_retrofit-2.7.2.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.squareup.retrofit2_retrofit-2.7.2.jar with timestamp 1631466307040
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.squareup.okhttp3_okhttp-3.12.6.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.squareup.okhttp3_okhttp-3.12.6.jar with timestamp 1631466307046
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.squareup.okhttp3_logging-interceptor-3.12.2.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.squareup.okhttp3_logging-interceptor-3.12.2.jar with timestamp 1631466307057
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.squareup.okhttp3_okhttp-urlconnection-3.12.2.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.squareup.okhttp3_okhttp-urlconnection-3.12.2.jar with timestamp 1631466307058
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.squareup.retrofit2_converter-jackson-2.7.2.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.squareup.retrofit2_converter-jackson-2.7.2.jar with timestamp 1631466307063
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.fasterxml.jackson.datatype_jackson-datatype-joda-2.10.1.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.fasterxml.jackson.datatype_jackson-datatype-joda-2.10.1.jar with timestamp 1631466307064
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/org.apache.commons_commons-lang3-3.4.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/org.apache.commons_commons-lang3-3.4.jar with timestamp 1631466307066
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/io.reactivex_rxjava-1.3.8.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/io.reactivex_rxjava-1.3.8.jar with timestamp 1631466307077
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.squareup.retrofit2_adapter-rxjava-2.7.2.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.squareup.retrofit2_adapter-rxjava-2.7.2.jar with timestamp 1631466307082
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.google.code.findbugs_jsr305-1.3.9.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.google.code.findbugs_jsr305-1.3.9.jar with timestamp 1631466307083
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/org.checkerframework_checker-compat-qual-2.0.0.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/org.checkerframework_checker-compat-qual-2.0.0.jar with timestamp 1631466307093
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.google.errorprone_error_prone_annotations-2.1.3.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.google.errorprone_error_prone_annotations-2.1.3.jar with timestamp 1631466307099
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.google.j2objc_j2objc-annotations-1.1.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.google.j2objc_j2objc-annotations-1.1.jar with timestamp 1631466307111
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/org.codehaus.mojo_animal-sniffer-annotations-1.14.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/org.codehaus.mojo_animal-sniffer-annotations-1.14.jar with timestamp 1631466307116
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.squareup.okio_okio-1.15.0.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.squareup.okio_okio-1.15.0.jar with timestamp 1631466307129
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.fasterxml.jackson.core_jackson-databind-2.10.1.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.fasterxml.jackson.core_jackson-databind-2.10.1.jar with timestamp 1631466307133
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.fasterxml.jackson.core_jackson-annotations-2.10.1.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.fasterxml.jackson.core_jackson-annotations-2.10.1.jar with timestamp 1631466307145
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.fasterxml.jackson.core_jackson-core-2.10.1.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.fasterxml.jackson.core_jackson-core-2.10.1.jar with timestamp 1631466307149
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/joda-time_joda-time-2.9.9.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/joda-time_joda-time-2.9.9.jar with timestamp 1631466307154
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.nimbusds_oauth2-oidc-sdk-6.5.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.nimbusds_oauth2-oidc-sdk-6.5.jar with timestamp 1631466307155
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.google.code.gson_gson-2.8.0.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.google.code.gson_gson-2.8.0.jar with timestamp 1631466307164
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.sun.mail_javax.mail-1.6.1.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.sun.mail_javax.mail-1.6.1.jar with timestamp 1631466307170
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.github.stephenc.jcip_jcip-annotations-1.0-1.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.github.stephenc.jcip_jcip-annotations-1.0-1.jar with timestamp 1631466307179
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/net.minidev_json-smart-2.3.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/net.minidev_json-smart-2.3.jar with timestamp 1631466307183
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/com.nimbusds_lang-tag-1.5.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/com.nimbusds_lang-tag-1.5.jar with timestamp 1631466307197
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/javax.activation_activation-1.1.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/javax.activation_activation-1.1.jar with timestamp 1631466307201
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/net.minidev_accessors-smart-1.2.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/net.minidev_accessors-smart-1.2.jar with timestamp 1631466307210
21/09/12 10:05:07 INFO SparkContext: Added JAR file:///C:/Users/mwinick/.ivy2/jars/org.ow2.asm_asm-5.0.4.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/org.ow2.asm_asm-5.0.4.jar with timestamp 1631466307214
21/09/12 10:05:07 INFO SparkContext: Added JAR file:/C:/arcus/mySparkApp/bin/Debug/netcoreapp3.1/microsoft-spark-3-0_2.12-1.0.0.jar at spark://5CD034PMMX.tandemdiabetes.com:58884/jars/microsoft-spark-3-0_2.12-1.0.0.jar with timestamp 1631466307215
21/09/12 10:05:07 INFO Executor: Starting executor ID driver on host 5CD034PMMX.tandemdiabetes.com
21/09/12 10:05:07 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 58907.
21/09/12 10:05:07 INFO NettyBlockTransferService: Server created on 5CD034PMMX.tandemdiabetes.com:58907
21/09/12 10:05:07 INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
21/09/12 10:05:07 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, 5CD034PMMX.tandemdiabetes.com, 58907, None)
21/09/12 10:05:07 INFO BlockManagerMasterEndpoint: Registering block manager 5CD034PMMX.tandemdiabetes.com:58907 with 407.7 MiB RAM, BlockManagerId(driver, 5CD034PMMX.tandemdiabetes.com, 58907, None)
21/09/12 10:05:07 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, 5CD034PMMX.tandemdiabetes.com, 58907, None)
21/09/12 10:05:07 INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, 5CD034PMMX.tandemdiabetes.com, 58907, None)
21/09/12 10:05:07 INFO SharedState: Setting hive.metastore.warehouse.dir ('null') to the value of spark.sql.warehouse.dir ('file:/C:/arcus/mySparkApp/spark-warehouse').
21/09/12 10:05:07 INFO SharedState: Warehouse path is 'file:/C:/arcus/mySparkApp/spark-warehouse'.
21/09/12 10:05:08 ERROR DotnetBackendHandler: Failed to execute 'load' on 'org.apache.spark.sql.streaming.DataStreamReader' with args=()
[2021-09-12T17:05:08.4616754Z] [5CD034PMMX] [Error] [JvmBridge] JVM method execution failed: Nonstatic method 'load' failed for class '7' when called with no arguments
[2021-09-12T17:05:08.4617669Z] [5CD034PMMX] [Error] [JvmBridge] java.util.ServiceConfigurationError: org.apache.spark.sql.sources.DataSourceRegister: Provider org.apache.spark.sql.eventhubs.EventHubsSourceProvider could not be instantiated
        at java.util.ServiceLoader.fail(Unknown Source)
        at java.util.ServiceLoader.access$100(Unknown Source)
        at java.util.ServiceLoader$LazyIterator.nextService(Unknown Source)
        at java.util.ServiceLoader$LazyIterator.next(Unknown Source)
        at java.util.ServiceLoader$1.next(Unknown Source)
        at scala.collection.convert.Wrappers$JIteratorWrapper.next(Wrappers.scala:44)
        at scala.collection.Iterator.foreach(Iterator.scala:941)
        at scala.collection.Iterator.foreach$(Iterator.scala:941)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1429)
        at scala.collection.IterableLike.foreach(IterableLike.scala:74)
        at scala.collection.IterableLike.foreach$(IterableLike.scala:73)
        at scala.collection.AbstractIterable.foreach(Iterable.scala:56)
        at scala.collection.TraversableLike.filterImpl(TraversableLike.scala:255)
        at scala.collection.TraversableLike.filterImpl$(TraversableLike.scala:249)
        at scala.collection.AbstractTraversable.filterImpl(Traversable.scala:108)
        at scala.collection.TraversableLike.filter(TraversableLike.scala:347)
        at scala.collection.TraversableLike.filter$(TraversableLike.scala:347)
        at scala.collection.AbstractTraversable.filter(Traversable.scala:108)
        at org.apache.spark.sql.execution.datasources.DataSource$.lookupDataSource(DataSource.scala:649)
        at org.apache.spark.sql.streaming.DataStreamReader.load(DataStreamReader.scala:194)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
        at java.lang.reflect.Method.invoke(Unknown Source)
        at org.apache.spark.api.dotnet.DotnetBackendHandler.handleMethodCall(DotnetBackendHandler.scala:159)
        at org.apache.spark.api.dotnet.DotnetBackendHandler.$anonfun$handleBackendRequest$2(DotnetBackendHandler.scala:99)
        at org.apache.spark.api.dotnet.ThreadPool$$anon$1.run(ThreadPool.scala:34)
        at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
        at java.util.concurrent.FutureTask.run(Unknown Source)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
        at java.lang.Thread.run(Unknown Source)
Caused by: java.lang.NoClassDefFoundError: org/apache/spark/internal/Logging$class
        at org.apache.spark.sql.eventhubs.EventHubsSourceProvider.<init>(EventHubsSourceProvider.scala:57)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
        at java.lang.reflect.Constructor.newInstance(Unknown Source)
        at java.lang.Class.newInstance(Unknown Source)
        ... 30 more
Caused by: java.lang.ClassNotFoundException: org.apache.spark.internal.Logging$class
        at java.net.URLClassLoader.findClass(Unknown Source)
        at java.lang.ClassLoader.loadClass(Unknown Source)
        at java.lang.ClassLoader.loadClass(Unknown Source)
        ... 36 more

[2021-09-12T17:05:08.5066238Z] [5CD034PMMX] [Exception] [JvmBridge] JVM method execution failed: Nonstatic method 'load' failed for class '7' when called with no arguments
   at Microsoft.Spark.Interop.Ipc.JvmBridge.CallJavaMethod(Boolean isStatic, Object classNameOrJvmObjectReference, String methodName, Object[] args)
Unhandled exception. System.Exception: JVM method execution failed: Nonstatic method 'load' failed for class '7' when called with no arguments
 ---> Microsoft.Spark.JvmException: java.util.ServiceConfigurationError: org.apache.spark.sql.sources.DataSourceRegister: Provider org.apache.spark.sql.eventhubs.EventHubsSourceProvider could not be instantiated
        at java.util.ServiceLoader.fail(Unknown Source)
        at java.util.ServiceLoader.access$100(Unknown Source)
        at java.util.ServiceLoader$LazyIterator.nextService(Unknown Source)
        at java.util.ServiceLoader$LazyIterator.next(Unknown Source)
        at java.util.ServiceLoader$1.next(Unknown Source)
        at scala.collection.convert.Wrappers$JIteratorWrapper.next(Wrappers.scala:44)
        at scala.collection.Iterator.foreach(Iterator.scala:941)
        at scala.collection.Iterator.foreach$(Iterator.scala:941)
        at scala.collection.AbstractIterator.foreach(Iterator.scala:1429)
        at scala.collection.IterableLike.foreach(IterableLike.scala:74)
        at scala.collection.IterableLike.foreach$(IterableLike.scala:73)
        at scala.collection.AbstractIterable.foreach(Iterable.scala:56)
        at scala.collection.TraversableLike.filterImpl(TraversableLike.scala:255)
        at scala.collection.TraversableLike.filterImpl$(TraversableLike.scala:249)
        at scala.collection.AbstractTraversable.filterImpl(Traversable.scala:108)
        at scala.collection.TraversableLike.filter(TraversableLike.scala:347)
        at scala.collection.TraversableLike.filter$(TraversableLike.scala:347)
        at scala.collection.AbstractTraversable.filter(Traversable.scala:108)
        at org.apache.spark.sql.execution.datasources.DataSource$.lookupDataSource(DataSource.scala:649)
        at org.apache.spark.sql.streaming.DataStreamReader.load(DataStreamReader.scala:194)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
        at java.lang.reflect.Method.invoke(Unknown Source)
        at org.apache.spark.api.dotnet.DotnetBackendHandler.handleMethodCall(DotnetBackendHandler.scala:159)
        at org.apache.spark.api.dotnet.DotnetBackendHandler.$anonfun$handleBackendRequest$2(DotnetBackendHandler.scala:99)
        at org.apache.spark.api.dotnet.ThreadPool$$anon$1.run(ThreadPool.scala:34)
        at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
        at java.util.concurrent.FutureTask.run(Unknown Source)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
        at java.lang.Thread.run(Unknown Source)
Caused by: java.lang.NoClassDefFoundError: org/apache/spark/internal/Logging$class
        at org.apache.spark.sql.eventhubs.EventHubsSourceProvider.<init>(EventHubsSourceProvider.scala:57)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
        at java.lang.reflect.Constructor.newInstance(Unknown Source)
        at java.lang.Class.newInstance(Unknown Source)
        ... 30 more
Caused by: java.lang.ClassNotFoundException: org.apache.spark.internal.Logging$class
        at java.net.URLClassLoader.findClass(Unknown Source)
        at java.lang.ClassLoader.loadClass(Unknown Source)
        at java.lang.ClassLoader.loadClass(Unknown Source)
        ... 36 more

   --- End of inner exception stack trace ---
   at Microsoft.Spark.Interop.Ipc.JvmBridge.CallJavaMethod(Boolean isStatic, Object classNameOrJvmObjectReference, String methodName, Object[] args)
   at Microsoft.Spark.Interop.Ipc.JvmBridge.CallNonStaticJavaMethod(JvmObjectReference objectId, String methodName, Object[] args)
   at Microsoft.Spark.Interop.Ipc.JvmObjectReference.Invoke(String methodName, Object[] args)
   at Microsoft.Spark.Sql.Streaming.DataStreamReader.Load()
   at Sample.Program.Main(String[] args) in C:\arcus\mySparkApp\Program.cs:line 22
21/09/12 10:05:09 INFO DotnetRunner: Closing DotnetBackend
21/09/12 10:05:09 INFO SparkContext: Invoking stop() from shutdown hook
21/09/12 10:05:09 INFO SparkUI: Stopped Spark web UI at http://5CD034PMMX.tandemdiabetes.com:4040
21/09/12 10:05:09 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
21/09/12 10:05:09 INFO MemoryStore: MemoryStore cleared
21/09/12 10:05:09 INFO BlockManager: BlockManager stopped
21/09/12 10:05:09 INFO BlockManagerMaster: BlockManagerMaster stopped
21/09/12 10:05:09 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
21/09/12 10:05:09 INFO SparkContext: Successfully stopped SparkContext
21/09/12 10:05:09 INFO ShutdownHookManager: Shutdown hook called
21/09/12 10:05:09 INFO ShutdownHookManager: Deleting directory C:\Users\mwinick\AppData\Local\Temp\spark-d82ba83c-7d33-459d-b7fc-af79f01b2f57
21/09/12 10:05:09 INFO ShutdownHookManager: Deleting directory C:\Users\mwinick\AppData\Local\Temp\spark-ca9b1d45-2bc2-4adf-9af5-9819be6cb32b