IssueTracker

AppFunctions would like to support native Java/Android object types in the schema function signature.

This include types like:

• LocalDateTime
• Uri
• PendingIntent

While it is possible to directly support these types as is done already for PendingIntent in b/400422328, this type of support will make the object types opaque to an Agent LLM as the SDK does not expose a contract/constructor for how this java/android type should be constructed. For cases where we expect the Agent LLM to construct this java/android type, this direct support approach does not work.

However, the AppFunction SDK already supports Constructible types as data classes annotated with @AppFunctionSerializable. Hence, the goal is to support "internally swappable" types in App Functions sdk.

At a very high level this means when we have a function signature that utilizes a swappable type like LocalDateTime, it's equivalent metadata representation should be an LLM friendly serializable type like:

@AppFunctionSerializable
class LocalDateTime(
  val hours: Int,
  val minutes: Int,
  val seconds: Int,
  val nanos: Int,
) {}