What you’re looking for is Seq[o.a.s.sql.Row]: import org.apache.spark.sql.Row val my_size = udf { subjects: Seq[Row] => subjects.size } Explanation: Current representation of ArrayType is, as you already know, WrappedArray so Array won’t work and it is better to stay on the safe side. According to the official specification, the local (external) type for StructType is … Read more
No, there is no way — create/drop is the only choice.
It looks like you want to register a listener to a spreadsheet component. To satisfy your goal, you could add the listener to the spreadsheet object it self, or to another nested object that implements an interface that supports an add.+EventListener() method. Below is a pair (broadcaster/listener) that I can think you could use in … Read more
I have connected to my MySQL server and simply executed this statement in MySQL Workbench, and it simply worked – I now have new function levenshtein(). For example, this works as expected: SELECT levenshtein(‘abcde’, ‘abced’) 2
OUTER APPLY: SELECT Stuff.id ,Results.pn ,Results.s FROM stackoverflow_454945 AS Stuff OUTER APPLY dbo.Split(‘,’, Stuff.myColumn) AS Results WHERE ISNULL(Results.s,”) <> ”
you want to use FROM E.g : select … FROM fn_GetConfigurationByProfile(‘DEFAULTPROFILE’) SQL Server User-defined Functions
Declare your arguments as Optional Variants, then you can test to see if they’re missing using IsMissing() or check their type using TypeName(), as shown in the following example: Public Function Foo(Optional v As Variant) As Variant If IsMissing(v) Then Foo = “Missing argument” ElseIf TypeName(v) = “String” Then Foo = v & ” plus … Read more
You need to add WITH (NOLOCK). Not entirely sure why but I just ran into this issue today and this solved my issue. SELECT * FROM [110.10.10.100].testdbname.dbo.ufn_getdata(‘4/25/2013’) AS tb WITH (NOLOCK);
You need to initialize a StringType instance: label_udf = udf(my_udf, ArrayType(StringType())) # ^^ df.withColumn(‘subset’, label_udf(df.col1)).show() +————+——+ | col1|subset| +————+——+ | oculunt|[s, n]| |predistposed|[s, n]| | incredulous|[s, n]| +————+——+
This is where Optioncomes in handy: val extractDateAsOptionInt = udf((d: String) => d match { case null => None case s => Some(s.substring(0, 10).filterNot(“-“.toSet).toInt) }) or to make it slightly more secure in general case: import scala.util.Try val extractDateAsOptionInt = udf((d: String) => Try( d.substring(0, 10).filterNot(“-“.toSet).toInt ).toOption) All credit goes to Dmitriy Selivanov who’ve pointed … Read more