Tuesday, August 7, 2012

Google App Engine General Questions For Creating New GWT(Web) Application


How do I sign into my Google App Engine account?

For normal Google Accounts, including Gmail users, you can log into your App Engine account by visiting:
For users with accounts through Google Apps:
  • https://appengine.google.com/a/<DOMAIN.COM>
  • Where <DOMAIN.COM> is the domain that your account is associated with.

What languages are supported by Google App Engine?

Currently, Google App Engine supports two application environments: Java and Python. Additionally, your website templates can include JavaScript along with your HTML which, among other things, allows you to write AJAX-enabled web applications.

Java

App Engine applications can also be written in Java or any JVM-compatible language (e.g. JRuby, Groovy, Scala, etc.) and run in a Java 6 runtime environment. The same sandbox restrictions noted above apply to Java applications and are summarized in the documentation. Also, Java-based applications may only use the JRE classes in theJRE class white list.

Python

App Engine's Python runtime supports Python 2.5 – newer versions of Python, including Python 2.6, are not currently supported. For security reasons, some Python modules written in C won't run in App Engine's sandbox. Because App Engine doesn't support writing to disk or opening direct network connections, other libraries that rely on this may not be fully usable. The documentation provides a good overview of the Python runtime environment. A full list of Python libraries that are disabled or partially disabled is available here.

What frameworks does Google App Engine Support?

Java

App Engine's Java runtime works with many popular Java frameworks including Struts 2 and Spring MVC. App Engine also supports several popular JVM-compatible languages such as JRuby and Scala. All frameworks must operate inside the restrictions of App Engine's sandbox and only use the JRE classes in the JRE class white list.A list of App Engine-compatible Java libraries and frameworks is available here.

Python

App Engine can run most Python web frameworks out-of-the box with few or no modifications. For your convenience, Django 0.96 is included with the Google App Engine SDK and Django versions 1.0.2 and 1.1 are available in the runtime when running on App Engine. More information is available in the documentation on third-party libraries.

Can I still develop a Google App Engine app if I don't have an account?

Absolutely! Even if you don't yet have a Google App Engine account you can always download our SDK and start developing.

How many applications can I create with Google App Engine?

Each developer can create 10 applications with their Google App Engine administrator account. You can delete your existing applications via the Admin Console if you want to create more, but you will not be able to re-register an application ID.

How can I disable one of my existing applications?

You can disable, and subsequently re-enable, your application in the "Application Settings" page in the Admin Console. You can also permenantly delete your application. For more information see the Admin Console FAQ.

What type of content is allowed on Google App Engine?

Please see our Terms of Service if you have questions on what kind of content is allowed with Google App Engine.

How do I read the system usage charts in the admin console for my app?

Your Google App Engine dashboard in the Admin Console has six graphs that give you a quick visual reference of your system usage. The information displayed in these graphs gives you a snapshot of resource consumption per second over a period of up to 30 days. Here are a list of the graphs you will see in the Admin Console:
  • Requests/Second: The number of URIs requested from your application every second, including dynamic, static, and cached requests.
  • Milliseconds/Request: The average number of milliseconds your application takes to service a request (latency measure), including only dynamic requests.
  • Errors/Second: The number of errors generated by your application every second
  • Bytes Received/Second: The number of bytes that are received in a request every second
  • Bytes Sent/Second: The number of bytes sent in a request every second
  • CPU Seconds Used/Second: The amount of CPU megacyles your application uses every second
  • Milliseconds Used/Second: The number of milliseconds per second your app is handling a request
  • Number of Quota DenialsSecond: The number of times a request to your application was denied due to esceeding quotas; see Quotas for a complete overview
Note: These charts reflect the time it takes the runtime to process the request. They do not reflect the time it takes to deliver the request to the client.

How is the current load report in my application's admin console generated?

The current load gives a breakdown of the number of requests for each URI requested from your application as well as some CPU stats for the URI. The request parameters are omitted from the path.
The leftmost column lists the URI path, starting with the most popular URI by total requests, which is listed under the "Requests" column. The number of requests is reset every Midnight PST. The "Req/Sec" column lists the short-term request rate of each URI.
The current load table provides two data points for CPU usage, "Avg CPU (API)" and "% CPU". The "Avg CPU (API)" displays the average amount of CPU a request to that URI has consumed over the past hour, measured in megacycles. The "% CPU" column shows the percentage of CPU that URI has consumed since midnight PST with respect to the other URIs in your application.

How do you generate the list of URIs showing the most errors in my application's admin console?

If any error occurs when attempting to load a URI, our system records that error. We then show the URIs that record the most errors in the past 24 hrs in the admin console. In addition to showing the total number of errors, we include the percentage of errors as the ratio of errors at the URI to total requests of that URI.
Applications who have not included a favicon.ico file may notice the URI /favicon.ico on the list of errorful URIs. Favicon.ico is a file that is requested by a user's web browser when it attempts to load the page. Favicon.ico is your website's icon, and is typically displayed in the user's browser URL bar, next to the web address of your site.
For your application, favicon.ico should be a static image. You can upload a favicon.ico file with your application, and in your app.yaml file configure your application to serve the image when the url /favicon.ico is requested. Below are example entries in appengine-web.xml (Java) and app.yaml (Python). In the Python example,favicon.ico is located in static/images. For simplicity, the same file is located in the root (war) directory in the Java example.

What is GQL?
GQL is a query language that is used with the App Engine datastore. You can use it to query for entities in both the Python runtime environment as well as the datastore viewer in the Admin Console. It uses a SQL-like syntax to retrieve entire entities from your application's datastore and includes the ability to filter on properties, specify the sorting order of the results, and limit the number of entities returned. The full GQL language reference can be found here.

Why do my queries need to be covered by indexes, and how do I include them?

If you run a query that filters on multiple entity properties or orders results by multiple properties, you will need an index for that query. You must have an index for every query of that kind that you run with your application. The datastore index for a query maintains and updates a list of keys sorted in the manner that the query specifies to allow speedy access to the data in your datastore. A full explanation of datastore indexes can be found in our documentation (Java | Python).
When you develop your application with Google App Engine SDK, every query you run automatically gets indexed when necessary. If you thoroughly test your application before uploading it to your website, all of the indexes your application will need will be included in your application's datastore-indexes.xml (Java) or index.yaml(Python) files. You may manually add indexes if you find a query that was not covered by your development testing. For more information on how to write indexes for your application, see the index documentation (Java | Python).

Why were my indexes marked as Error?

They may be exploding indexes, or may have encountered other similar problems when writing particular entities in your datastore. You can vacuum and re-attempt to build them by following the instructions in Queries and Indexes.

Why do my indexes stay Building or Deleting for long periods of time?

Even if you don't have many entities of the corresponding kind(s), the time indexes take to build or delete can vary widely depending on the total amount of data in your datastore, indexes currently building for other apps, and datastore load due to user requests, among other factors. In some cases, index jobs can take hours or even days to complete.
Even so, we can sometimes help with indexes that seem to be stuck. If you think this has happened to your indexes, feel free to ask us on the group.
In the past, index jobs sometimes slowed down because worker shards were too large to be completed within the lease period. We initially addressed this by increasing the lease period. Later, we started splitting individual tablets into shards.

How do I authenticate users of my application?

The Users service (Java | Python) allows you to authenticate users who have a Google Accounts, user account on your own Google Apps domain, or an OpenID. You choose one of these forms of authentication for your app. Please read our article on how to configure your application to authenticate against a Google Apps domain.
If your app uses Google Accounts, when your application requests a user sign in, the user is directed to a Google sign-in page to enter a username and password, or to create a new account. If your app uses OpenID and requests a sign-in, the user is directed to /_ah/login_required to provide an OpenID and password. After successfully signing in, the user is then returned to your website, and the user information is available to your application through the Users property.

Are there any third-party libraries not supported by Google App Engine?

Java

For a list of compatible and incompatible libraries and frameworks, please see Will it Play in App Engine.

Python

A small percentage of native C python modules, and subsets of native C python modules are not available with Google App Engine. A full list detailing native C Python module support can be found here. The disabled modules fall in to the following categories:
  • Libraries that maintain databases on disk are not enabled in Python for Google App Engine
  • Sockets are disabled with Google App Engine
  • The system does not allow you to invoke subprocesses, as a result some os module methods are disabled
  • Threading is not available
  • For security reasons, most C-based modules are disabled
  • Other features that are limited:
    • marshal is disabled
    • cPickle is aliased to pickle
    • System calls have been disabled
Please keep in mind that third party packages which use any of the above features will not function with Google App Engine (packages such as MySQL, PostgreSQL, etc).

Why did my app get disabled?

An app may be disabled if it fails to abide by our Terms and Conditions. Additionally, if an application is found to be using an inordinate amount of system resources due to a bug or other issue leading to inefficient resource usage, we may disable the app so that the developer can fix the development issues using our development SDK before re-enabling the application on Google App Engine.

Why is my app over quota?

App Engine places quota limits on the amount of each system resource that an application can consume in a day. All applications have a default quota configuration, the "free quotas", which should allow for roughly 5 million pageviews a month for an efficient application. You can read more about system quotas in the quota documentation.
As your application grows, it may need a higher resource allocation than the default quota configuration provides. You can purchase additional computing resources by enabling billing for your application. Billing enables developers to raise the limits on all system resources and pay for even higher limits on CPU, bandwidth, storage, and email usage.

How do I report an application that is in violation of your Terms and Conditions?

To report an application that is in violation of the Google App Engine Terms and Condition, please contact us. We will determine if the application is in violation, and if necessary, contact the application's developer over the violation.

Should I use the SDK for serving external requests?

The dev_appserver is designed for local testing and disallows external connections by default. You can override this using the -a <hostname> flag when running it, but doing so is not recommended because the SDK has not been hardened for security and may contain vulnerabilities.

How do I serve compressed content?

Google App Engine does its best to serve gzipped content to browsers that support it. Taking advantage of this scheme is automatic and requires no modifications to applications.
We use a combination of request headers (Accept-Encoding, User-Agent) and response headers (Content-Type) to determine whether or not the end-user can take advantage of gzipped content. This approach avoids some well-known bugs with gzipped content in popular browsers. To force gzipped content to be served, clients may supply 'gzip' as the value of both the Accept-Encoding and User-Agent request headers. Content will never be gzipped if no Accept-Encoding header is present.
This is covered further in the runtime environment documentation (Java | Python).

Does Google App Engine support SSL (HTTPS)?

Google App Engine allows you to serve SSL (HTTPS) traffic through your appspot.com domain. Simply add the 'secure' parameter to your app.yaml handler for the URLs through which you wish to support secure traffic. For complete information on how to configure your application for secure traffic, please see the docs on app configuration (Java | Python).

Can I use SSL (HTTPS) on App Engine with my Google Apps domain?

Do tools like appcfg use SSL (HTTPS)?

The SDK tools which use login (appcfg, remote_api, appengine_rpc) all use SSL when communicating your email address and password. In addition, appcfg uses SSL when connecting to the Admin Console by default, unless the --insecure flag is passed.
The Python SDK has the ability to validate the SSL certificate over the remote connection as of version 1.3.1. To do this you must have the ssl Python module installed on your system. If you are using Python 2.5, you can install the module from http://pypi.python.org/pypi/ssl/. If there is an error validating the SSL certificate, the Python tools will raise an InvalidCertificateException explaining what went wrong.
As of the 1.3.1 release, the Java SDK also enables SSL by default. If an error is encountered while validating the SSL certificate it will throw ajavax.net.ssl.SSLHandshakeException.

I'd like to map my app to http://myurl.com (also known as a naked domain).

Due to recent changes, App Engine no longer supports mapping your app to a naked domain. If your domain registrar supports URL redirects, you can redirect from http://yourdomain.com to e.g http://www.yourdomain.com or http://appid.yourdomain.com.
For instructions on how to configure a redirect for your Google Apps domain, please see the Google Apps FAQ on URL forwarding (redirection).

Static IP Addresses and App Engine apps

App Engine does not currently provide a way to map static IP addresses to an application, due to its design. The inbound IP address for App Engine for two different users may be different, as users in different locations are routed to frontend servers in different Google data centers, in order to optimize the network path between each user and the application's App Engine instances. IP addresses, as returned by DNS lookups, can and do change over time.
Outbound services, such as URL Fetch and the Mail API, make use of a large pool of IP addresses. The IP address ranges in this pool are subject to routine changes. In fact, two sequential API calls from the same application may appear to originate from two different IP addresses.
Note: To see the current set of IP blocks used by Google, invoke the Unix dig command as follows:
dig -t TXT _netblocks.google.com @ns1.google.com
If you want static IP addresses in order to implement some sort of IP filtering, you should reconsider using IP filtering. An attacker could set up a malicious App Engine app (which would also be in the IP address list). IP addresses can be spoofed. Instead, we suggest that you take a defense in depth approach using OAuth and Certs.

How do I define cron jobs for my application?

Please consult the language specific documentation for information on defining cron jobs for your application (Java | Python).

What are task queues?

Task queues provide a mechanism for dynamically adding new requests to be fulfilled at a later point in time. If an app needs to execute some background work, it can use the Task Queue API to organize that work into small, discrete units called Tasks. Tasks are inserted into one or more Queues. App Engine automatically detects new Tasks and executes them when system resources permit. For more details, see the documentation for the Task Queue API (Java | Python).

How many active requests can my app serve at one time?

Google App Engine allocates resources to your application automatically as traffic increases to support many simultaneous requests. However, App Engine reserves automatic scaling capacity for applications with low latency, where the application responds to requests in less than one second. Applications with very high latency (over one second per request for many requests) are limited by the system, and require a special exemption in order to have a large number of simultaneous dynamic requests. If your application has a strong need for a high throughput of long-running requests, you can request an exemption from the simultaneous dynamic request limit. The vast majority of applications do not require any exemption.
Applications that are heavily CPU-bound may also incur some additional latency in order to efficiently share resources with other applications on the same servers. Requests for static files are exempt from these latency limits.

How do I prevent users/subnets from accessing my app?

App Engine provides a DoS Protection Service that enables you to blacklist IP addresses or subnets. For more details, see the documentation for the DoS Protection Service (Java | Python).

No comments:

Post a Comment