A spring batch StepScope object is one which is unique to a specific step and not a singleton. As you probably know, the default bean scope in Spring is a singleton. But by specifying a spring batch component being StepScope means that Spring Batch will use the spring container to instantiate a new instance of … Read more
These parameters in the JDBC connection URL can make a big difference in the speed of batched statements — in my experience, they speed things up: ?useServerPrepStmts=false&rewriteBatchedStatements=true See: JDBC batch insert performance
You can use Spring’s CompositeItemWriter and delegate to it all your writers. here is a configuration example.
UPDATE: As of spring 2.5.0, you should use spring.batch.jdbc.initialize-schema instead. See source. With Spring Boot 2.0 you probably need this: https://docs.spring.io/spring-boot/docs/2.0.0.M7/reference/htmlsingle/#howto-initialize-a-spring-batch-database spring.batch.initialize-schema=always By default it will only create the tables if you are using an embedded database. Or spring.batch.initialize-schema=never To permanently disable it.
The jobs execution can be prevented by setting spring.batch.job.enabled=false in application.properties. Or you can use spring.batch.job.names it takes a comma-delimited list of job names that will be run. Taken from here: how to stop spring batch scheduled jobs from running at first time when executing the code?
Ok, this is strange but it works. Moving the datasources to it’s own configuration class works just fine and one is able to autowire. The example is a multi-datasource version of Spring Batch Service Example: DataSourceConfiguration: public class DataSourceConfiguration { @Value(“classpath:schema-mysql.sql”) private Resource schemaScript; @Bean @Primary public DataSource hsqldbDataSource() throws SQLException { final SimpleDriverDataSource dataSource … Read more
What Celery is doing is very much akin to EIP, and SEDA with convenient task scheduling… (all you have left to do is add some DB, and async HTTP networking and you have got a complete enterprise quality stack). Basically in Java there is the Spring way, the Java EE way, and the Hadoop way: … Read more
A few pointers: Spring Batch HelloWorld Spring Batch “Hello World” 1 Spring Batch “Hello World” 2 A first look at Spring Batch (via archive.org) A first look at Spring Batch, part 2 (via archive.org) Spring Batch : Hello World!
You must provide your own BatchConfigurer. Spring does not want to make that decision for you @Configuration @EnableBatchProcessing public class BatchConfig { @Bean BatchConfigurer configurer(@Qualifier(“batchDataSource”) DataSource dataSource){ return new DefaultBatchConfigurer(dataSource); } …
Simply create a configuration without datasource for Batch configuration : @Configuration @EnableAutoConfiguration @EnableBatchProcessing public class BatchConfiguration extends DefaultBatchConfigurer { @Override public void setDataSource(DataSource dataSource) { // override to do not set datasource even if a datasource exist. // initialize will use a Map based JobRepository (instead of database) } } It will initialize JobRepository and … Read more